Lectures 1 and 2 


We should start with administrative stuff from the syllabus. 

• Instructor: Michael Damron 

— mclamron at indiana dot edu 

— 315 Rawles Hall 

— 812-855-8670 

• grader: Yu-yuan Chen (as last semester) 

• office hour times 

— Please send me an email with all times during which you cannot make it to office 
hours. 

• Text: same as last semester. Billingsley. Probability and measure, 3rd ed. 

• homework due on Wednesday in class. There is no homework due this Wednesday but 
there will be one due next Wednesday. I will post it on Wednesday. 

• Grade breakdown: 40 points homework, 40 points final (take home), 20 points midterm 
(in class) 

• Topics: finish convergence in distribution, ergodic theorem, infinitely divisible laws; 
conditional expectation, martingales; stochastic processes, Brownian motion. If there 
is left over time we can discuss additional topics. 

1 Weak convergence in 

We will begin by discussing extensions of distributional convergence statements from R. to 
for d> 2. This will serve to both cover this material and also review material from last 
semester. Many statements will not be proved, as they are similar to the ones we showed in 
d — 1. 

Definition 1.1. A sequence (fj, n ) of (Borel) probability measures on R d converges weakly to 

d If 

F n (x) —» F{x) for all continuity points x of F . 

Here F n , F are the distribution functions of p: 

( d 

F{x) = F(x i,..., x d ) = [i I JJ(-oo, Xi] 

\i =1 

In this case we say F n —* F weakly. Further if (X n ) is a sequence of random variables with 
laws n n then X n converges to X in distribution (and write X n => X) if fi n —>• p weakly. 




Just as in the one-dimensional setting, we have many equivalent conditions for weak 
convergence. 

Theorem 1.2 (Portmanteau in M d ). Let (fJ> n ), p be probability measures on R d with distri¬ 
bution functions (F n ), F. The following are equivalent. 

1. p n —y p weakly. 

2. f f dp n —tffdp for all bounded continuous f : —* M. 

3. n n (A ) —> p(A) for all Borel Acl d such that p(dA) = 0. 

4- lirn sup n p n (C) < p(C) for all closed C C 

5. liminf n p, n (0) > p(O) for all open O C R d . 

Proof. The first three statements are analogues of ones we proved were equivalent in one- 
dimension. You can read the equivalence of these in higher dimensions in Billingsley, Theo¬ 
rem 29.1. The last two are equivalent simply by taking complements. So we will only show 
that 2 implies 4 and 4 and 5 imply 3. 

Assume 4 and 5. For any A with p(dA) = 0, write int A for the interior of A and A for 
the closure of A. Then 


limsup/r n (A) < p(A) = p{int A) + p(dA) = pfint A) < liminf p n (int A) . 

n n 

However p n (A) > p n fint A ), for all n, so 3 holds. 

To show 2 implies 4 we will approximate the indicator of C by a bounded continuous 
function. So given e > 0 define the enlarged set 

C e = {x G : dist(x, C) < e} . 

Now set f e : —> [0,1] as the function which equals 1 on C, 0 on Cf and is linear in 

between: 

J° if x C e 

AW - ji_ distfec) [f xeCe - 

This is a continuous function and because C is closed, you can check that f e (x) 1 c(x) for 
all x (for a general C this would converge to the indicator of C ). So under 2, we get 


TnfC) < 


fe{x) d Hn(x) ->■ 


fe(x) d n(x) . 


By monotone convergence, the right converges as e —> 0 to /i(C ) so we obtain 4. □ 

From this version we can derive the d-dimensional version of the mapping theorem. Recall 
that if p is a probability measure on M. d and / : is measurable then the assignment 

pf~\A) = /i ( f~\A )) , A cR k Borel 

dehnes a probability measure on this is the push forward of p through /. 
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Theorem 1.3 (Mapping theorem). Let (pi n ) be a sequence of probability measures on R d that 
converge weakly to p. If f : R d —* write Df for its set of discontinuities. If pi(Df) = 0 
then /inf- 1 —> pf- 1 weakly. 

Proof. We will show that if C is closed then 

limsup//„ (/"^C)) <//(/ _1 (C)) . (1) 

n 

To do this, first note that 

rHcjcDfur'ic). 

Indeed, if x G / -1 (C) but x ^ Df, we will show that x G / -1 (C). / is continuous at x, so 
letting ( x n ) be a sequence in / _1 (C') which converges to x, we have f(x n ) —> f(x). Since C 
is closed and each f(x n ) is in C, we also have f(x) G C; that is, x G / -1 (C). 

Since fi n —>• /i weakly, 

limsup y u n (/ _1 (C')) < limsup p n {f~ l {C)) 

n n 

< l(FW)) < p(D f ) + ^f-\c)) = p(r\c)) , 

showing (1). □ 

As before, this implies that if / is continuous then ii n f~ l —» pf^ 1 weakly. In other words, 
if X„ —)■ A" in distribution and / is continuous then f{X n ) —> /(A") in distribution. 

To finish the general discussion of weak convergence, we recall the notion of tightness. 

Definition 1.4. A sequence (/i n ) of probability measures on R d is tight if for each e > 0 
there exists a compact set K such that 

Pn(K) > 1 — e for all n . 

Just as in one dimension, 

Theorem 1.5. If (p, n ) is tight, there exists a probability measure on R d and a subsequence 
( Hn k ) such that fx nk —> p weakly. 

2 Multidimensional characteristic functions 

In the one dimensional case, we defined the characteristic function of probability measure 
pi as 4>n(t) = f e ltx d pt(x). In higher dimensions, we simply replace the product with dot 
product. 

Definition 2.1. Let pi be a probability measure on R d . The characteristic function of pi is 
: R d —> M given by 

= J e lt ' x d/i{x) . 
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Here are some properties. 

1. The characteristic function uniquely identifies the measure by an inversion formula 
analogous to the one in one dimension. Precisely, if A C R d is a rectangle of the form 


then 


d 

A = bi\ with n(dA) = 0 , 

1=1 


M = J im 




^,—itjdj g —itjbj 


it n 


(f>n(t) d t . 


2. Let X = (Ad,..., X d ) be a random vector with characteristic function cf>x■ There is 
an idea, called the Cramer-Wold device, to consider t ■ X as a random variable (one 
dimensional random vector) for fixed t E R d . Its characteristic function is 

( f>t-x(s ) = for s E M . 


We claim that /i, the distribution of A", is uniquely determined by the values it gives 
to half spaces. Indeed, if we know the measure of each half-space, then we know the 
measure of each set of the form {x : t-x < a} (over all tel 11 and a E M). This means 
that we know the distribution of the variable t ■ X for all t E R d and thus the value of 
for all t E W l and sGR. Taking s — 1, we obtain the value of Ee 4t ' x for all 
t G that is, the characteristic function of X. By uniqueness we recover /i. 

Billinglsey remarks that this result on half-spaces is (as of the publication of the book) 
does not have an elementary proof without using characteristic functions. 


3. There is a continuity theorem for d-dimensions: we have 

H n —* ii weakly if and only if <j) n (t ) — > (p{t) point wise . 

The proof reduces to one-dimension using the Cramer-Wold device. See Billingsley, 
p.383. 

4. We can also use these ideas to show that generally it suffices to reduce to the one- 
dimensional case. 

Proposition 2.2. Let X n = (Ad jn , ..., X d ^ n ) and Y = (Y \,..., Y d ) be random vectors. 
Then X n Y if and only if X n - t => Y - t for all t EW l . 


Proof. If X n Y then since x 4 Li is continuous, the mapping theorem implies 
t ■ X n => t - Y. Conversely, if t ■ X n => t -Y for all t E M. d then by the one-dimensional 
continuity theorem, 

Ee is ^' Xn) —>• Ee is(i ' y) for all sGi, tER d . 

Taking s = 1 gives <f>x n ~> 4 >y point wise and the d-dimensional continuity theorem 
shows X n => Y. □ 
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3 Gaussians and CLT 

Recall that a centered Gaussian variable is one with density function 


f(x) 
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where a 2 is the variance of the variable. The characteristic function is <f>(t) = e 2 ~. One 
natural generalization of this distribution to higher dimensions is: 


Definition 3.1. A random vector X = (Ad,..., Ad) has a (centered, or mean zero) Gaussian 
distribution if its characteristic function has the form 


4>x(t ) = exp 




for some d x d matrix A. Here we are viewing t as a row vector. 

We can ask: are there any such vectors? Well we can begin with a natural construction, 
given last semester in the homework. Let Ad,..., Ad be a sequence of i.i.d. (mean zero) 
standard Gaussians. Forming the vector X = (Ad,..., Ad) and calling it a d-dimensional 
standard Gaussian, we can find its characteristic function using independence and the one¬ 
dimensional formula: 


d 

Ee u ' x = Ee i{tlXl+ ~ +tdXd) = = exp 

3 =1 

This is a d-dimensional standard Gaussian with matrix A equal to the identity matrix. 

Generally, we can construct d-dimensional Gaussians by taking a linear transformation 
of the standard one. 

Proposition 3.2. Let A be a d x d matrix and X a standard d-dimensional Gaussian. 

1. The vector Y = AX is a d-dimensional Gaussian associated to matrix A. 

2. Defining E, the Covariance Matrix ofY as 

E ij = EYjYj 

then E = AA T . 

3. IfY and Y' are d-dimensional Gaussians with the same covariance matrix, they have 
the same distribution: the characteristic function is given by 

4>y{t ) = exp 
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Proof. Write the entries A ]k of A and X = (X r ,..., X d ). Then 


Yj — ^ Aj )k X k . 


k =i 


We can compute the characteristic function of Y directly using independence: 


Ee* 4 ' 1 = E exp | i ^ tj 

3 =1 


^ ^ Aj )k A k 


,k =1 


= E exp bE X k 




d 


k=l U=1 

E exp ( iX k (tA) k ) 
(tA) • (tA) 


fc=i 

= exp 


The covariance can be computed, again using independence: E, :j equals 


d d 


EYjYj = E E E A,-,*, = EE 


,fc=i 


«=i 


fc=i /=i 


fc=i 


This proves parts 1 and 2. For 3, note that the covariance matrix determines the character¬ 
istic function, since we can write 


exp 


(tA) ■ (tA) 


= exp 


tAA T t T \ 


1 


= exp 


m 1 


□ 


Lecture 3 

• Note that E above is positive semi-definite. This follows because it is of the form AA T 
for a d. x d. matrix A: for all igl* 1 , 

Yx ■ x = A T x ■ A T x > 0 . 

• Conversely, if E is an arbitrary positive semi-definite matrix, we can factorize it as 
AA T for some matrix A. In other words, we can redefine a Gaussian as one with 
characteristic function 

t T Yt 
2 

for some positive semi-definite matrix E. 


0(f) = exp 
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3.1 CLT 


There are multidimensional generalizations of the Gaussian CLT and we will state the sim¬ 
plest here. In the one-dimensional CLT we assumed mean zero and finite variance. In the 
d-dimensional case we will assume mean zero and well-defined covariance matrix. Note that 
if X = (Ab,..., X (] ) is a random vector then 


miXj\ < 11 x^ 11 2 11 Xj 11 2 , 


so if KXf + • • • + X% < oo then X has a well-defined covariance matrix. 

Theorem 3.3 ((/-dimensional CLT). Let X^\ X^ 2 \ ... be an i.i.d. sequence of d-dimensional 


random vectors with mean zero and E 
covariance matrix for X^\ 


(Aft 2 + • • • + W) 


(!)\2 


< oo. Letting E be the 


X « + • • • + JW 

sjn 


N( 0,E) , 


where the distribution on the right is centered Gaussian with covariance matrix E. 

Proof. Use the Cramer-Wold device: let t G M d . We need only show that if Y is a N(0, E) 
vector, then 

XW + ■ ■ ■ + xw 

t ■ - -j= - => t -Y . 

yjn 

The left side is 

xd). t + • • • + xw ■ t 

7 = 5 

yn 

which is a normalized sum of mean-zero i.i.d. random variables with finite variance. Indeed, 
the mean is 

d 

EX ( d • t = Yl tiEXjV = 0 

i =1 

and the variance is 

Var [X ( L ■ t\ = Var = ^^UtjEX^Xf ] = ^ ^ =: a 2 t . 

i= 1 i= 1 j= 1 i= 1 j= 1 

So the one-dimensional CLT says this sum converges in distribution to a iV(0, of) variable. 
We just need to check this is the variance of t ■ Y, and this follows by exactly the same 
computation. 

□ 


7 



4 


Back to ID: infinitely divisible distributions 

4.1 Triangular arrays 

At the end of last semester, we investigated different generalizations of the standard one¬ 
dimensional central limit theorem. The main one was dne to Lindeberg, and was stated for 
triangular arrays. Let (X nk : n > 1, k = 1,,.., k n ) be an array of variables such that each 
row is independent: 


X n j,..., X n>kn are independent for each n . 


We assumed that all X nik s have mean zero and hnite variance. A main observation was that 
for us to expect a central limit theorem of the form S n /s n N( 0,1), where 


kn 

S n ^ ^ -^~n,k and s n Var S n , 

k= 1 


we would at least like the contribution of Var X nk to the variance s\ to go to zero as n —» oo: 


max{(T 


2 

n,l) • ‘ ' 


a, 


n,k n 


0 


( 2 ) 


where cA k = Var X H)k . A way to interpret this is that no variable in the n-th row contributes 
too much to the sum (at least measured in L 2 norm). By normalizing, we will assume 


sups^ < oo (3) 

n 


so that (2) implies that 

maxjff^,..., &n,k n } —^ 0 • (4) 

However (2) was not quite enough for a CLT. Now we will look at what other possible 
limits we can get under condition (2). The first step, as in the proof of Lindeberg is 


Theorem 4.1 (Accompanying Laws (simplified version)). If (2) holds then for each t e 


UMt) - 


yln^kiD 1 


k =1 


fc=l 


—> 0 as n —> oo . 


Here, 4> n ,k(t) is the characteristic function of X U)k . 

What is the meaning of this theorem? Let’s discuss this before the proof. 

1. The product n^li 4>n,k{t) is th e characteristic function of S n . The other is the charac¬ 
teristic function of a somewhat weirder variable. To see what it is, consider replacing 
each summand X n k in the sum S n by a random number of copies of itself. In other 



words, let Ni,... ,N kn be i.i.d. random variables with Poisson distribution (with pa¬ 
rameter 1). Now replace each X nk by a sum of N k i.i.d. copies of itself: define 


Y n , k = X 


(i) 

n,k 


x. 


(JVfc) 

n,k 


where the summands on the right are i.i.d. (One way to think of this is the value at 
time 1 of a compound Poisson process - this was in last semester’s final.) Then you 
can check that the characteristic function of Y n k is Therefore if we define 


T n — Y n ,i + • • • + Y n ,k n 

then the characteristic function of T n is ](lfc=i e^ >n ’ k ^~ 1 . 

2. The real theorem on accompanying laws actually holds without the variance assump¬ 
tion (2), but with a weaker, but similar, condition that all variables in the n-tli row are 
small. The theorem is slightly different, but asserts that we can replace all sums with 
“Poissonized” versions. See, for instance, Varadhan’s book. We will, however, assume 
( 2 ). 


Lecture 4 


Recall we are proving the following theorem on triangular arrays (X nk : n > 1, k — 1,..., k n ) 
that satisfy the conditions 

sup < oo (5) 

n 

and 


.<jJ ^0 ■ 


( 6 ) 


Theorem 4.2 (Accompanying Laws (simplified version)). If (12) and (6) hold then for each 

t e M, 


JJ <i>n,k{t) — < 


yln^kiD 1 


k =1 


k =1 


—> 0 as n —> oo . 


Here, is the characteristic function of X U)k . 

Proof. We will use a result that got a good amount of traction last semester. Recall that it 
was proved using induction. 

Lemma 4.3. If w i,..., w n and z 1} ..., z n are complex numbers of absolute value < 1 then 


n 

\w\ ■ ■ ■ W n z 1 ■ ■ ■ z n \ < ^ I Wi - Zi 

1=1 
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Fix t G BL We must check that wy = and Zi = satisfy the hypotheses of 

the lemma. However they are both characteristic functions (z t is the characteristic function 
of a compound Poisson process at time 1). So we can estimate 


i]/VA'(o - n 




k= 1 


k =1 


< Y ~ 


$11,k 0) 1 I 


k =1 


l*T 

n\ 


= z 


n + 2)! 


Set 9 nt k = 4> n ,k(t) — 1- Then this equals 

kn 

Y \e 6n ’ k - 1 - On,i 
k= 1 

However we can estimate 

OO 

\e z -l-z\ <Y 

n=2 

so the above is bounded by 

kn 

Y I O n ,k\ 2 e l ° n ’ kl . 

k =1 

Next we should estimate 0 ntk and use the mean-zero assumption: 

\0 n ,k\ < E \ e itXn ’ k - 1 - itX n , k | . 

By the general inequality 


E 

n=0 


< I z\ 2 e^ 



< min <j 

r 2 

\ x \ 


\ x \ 

n+1 | 

^ k\ 

k =0 

i 

n\ 

’ (n + 1)! J 


(proved in Billingsley (26.1)-(26.4) for n = 1, we get the bound 

Kk\ < EX^/2 = < fe /2 . 

This implies by (12) that 


kn 

Y\ \0 n ,k\ is bounded as n —> oo . 

fc=i 


Now we use (6) to deduce 

k k 

Y K,k\ 2 e^ < max |0 n , fc |e |e ™’ fcl Y KA ->• 0 
k=l k =1 

and we are done. 


□ 
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The advantage of using the Poissonized variables, that is, using the product n*=i e^ n ’ k ^ x , 
is that we can get a nice representation for them: 


( kn \ / kn i* 

Y &*,*(*) - 1 ) = exp I Y / ' 
k =1 / \k= 1^ 


e - 1 d// n ,fc(a;) , 


where fi n ^ is the distribution of X nk . We can further reduce this by using the fact that 
E X n k = 0, so this equals 


(kn /* 

Y / 1 

k =1 7 


— 1 — itx d/jL nj k(x) = 


(kn /» 

£ / 

fc=i j 


i ltx — 1 — itx 


x “ 


d/i njfc (x) 


Dividing by a; 2 is ok here since we know that 


— 1 — itx f 2 


ar 


—»-as x —> 0 . 

2 


If we define the measure /a n by /i n = x then we obtain 

r e itx _ 


exp 


or 


x d/i„(x) , 


and finally if we define z/ n by 


z/ n ((-oo,?/]) = / x 2 n n (x) , 


then the above equals 


exp 




1 — itx 


x z 


dz/ n (x) 


This is the representation we are going for. 


Theorem 4.4 (Limit theorem for triangular arrays). Let {X n k : n > 1, k = 1,..., k n ) be an 
array with each row independent, satisfying (12) and (6). Setting S n = X njl + • • • + X n ^ n , 
if S n => Y for some random variable Y then 


4>y’(t) = exp 


Atx 


— 1 — itx 


ar 



for all t el 


for some finite measure p on M. 

Proof. The accompanying laws theorem implies that if we set S' n to be a variable with 
characteristic function 


n e<t)n ’ k 1=ex p 

k =1 


Atx 


itx 


ar 



5 
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then S' n =>■ Y. To get a representation for Y we will try to simply take a limit of the 
measures u n . Unfortunately these are not probability measures, so we cannot directly apply 
the theory of weak convergence. However, for finite measures there is a related concept, 
vague convergence, which operates similarly. We will now summarize the relevant results. 

A sequence (u n ) of finite measures converges vaguely to a measure v if for each continuous 
/ : M —y R. with lini| a .|_ > . 0O f(x) = 0, one has 

J f d u n ->■ jfdn. 

This can be seen as a generalization of weak convergence in the case of probability measures. 
However the condition on the large-a: behavior of / essentially allows for cases in which mass 
escapes to infinity. For example, we can have a sequence of probability measures converg¬ 
ing vaguely to the zero measure. For this reason we do not need tightness for convergent 
subsequences: if we know simply that 


supi/ n (KJ < oo 


then we can find a measure v and a subsequence {y nk ) such that z/ nfc —> v vaguely. 

By (12), 


sup Ty n {K) = sup 

n n 


tin /» 

X 2 d ii n , k {x) = sup < oo . 

fc=l ^ n 


Therefore we can find a subsequence iy nk ) and a measure p, such that u Hk —> p, vaguely. Since 

” ltx — 1 — itx 


lim 

|tc| —^OO 


X* 


= 0 for each t , 


we also have 


and therefore 


1 —> exp 


k =1 


Atx 


1 — itx 


x “ 


dn(x] 


(t) —> exp 


k= 1 


Atx 


1 — itx 


x* 


dn(x] 


The left side is the characteristic function of S n , so since S n =>■ Y, the right side is the 


characteristic function of Y. 


□ 
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Lecture 5 


5 Infinitely divisible distributions 

We will see in this section that there is a different classification of the limits from the previous 
section: they are the infinitely divisible distributions. First let us understand a little better 
the functions from last section: for a finite measure /i on M, define 

= exp I^J -——— d \i{x) 

The integrand is defined as —t 2 /2 at x — 0. 

Examples. 

1. The characteristic function of a Gaussian with mean 0 and variance a 2 is 

,. . ifjn _t£o£ f f e ltx — 1 — itx . . A 

<t>(t) = & e 2 = exp IJ -—- d p(x)J , 



where // is a delta mass of size a 2 at 0: (i — cj 2 5q. Here the Gaussian has mean zero 
and variance /z(M). 

2. If X is Poisson with mean m then its characteristic function is 


Ee ltx = e“ 


u 


Therefore the characteristic function of A(V — m), where A > 0, is 


Ee i{t\) x e -U\ m = e m(e^-l) e -it\m = gxp ^ 


= exp ( A 2 m 


itX — 1 


and this equals &(X 2 m5\,t). In other words, A(A" — m) corresponds to the measure 
X 2 m5\. 

3. Said differently, the point mass a6b corresponds to the distribution of the variable 
b(X — ( a/b 2 )), where X is Poisson of mean a/b 2 . Therefore the mean of b(X — ( a/b 2 )) 
is zero and the variance is a. 

4. If H\ and /x 2 are finite measures then ^(/ri + /U 2 ,f) = f)<f > ( / u 2 , t). 

Theorem 5.1. For each finite measure /i on M, $(//, t) is the characteristic function of a 
variable with mean zero and variance /x(R). 
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Proof. If n is a point mass then we have already proved $(/i, t) is a characteristic function of 
a variable with mean zero and variance /i(M). For any sum of point masses [i = X)”=i a,S Xt , 
we have 

n 

$0M) = , 

i =1 

so it is the characteristic function of a sum of independent variables with mean zero and 
variance a*. This sum thus has mean zero and variance JT a* = (Xu Gh&Tj)(M). 

In the homework you will show that any finite measure yU can be written as a vague limit 
of a sequence (p, n ) such that each /i n is a finite sum of point masses and sup r)J u n (M) < oo. 
So given a finite measure fi, choose a sequence (/r n ) of finite measures (which are finite sums 
of point masses) that converges vaguely to yU. Then $(/i n ,f) —> $(/i, t) point wise (in t ) and 
since each <h(/i n ,t) is a characteristic function, we need only show that <F(yU, t) is continuous 
at zero to show that it is a characteristic function. (We proved this last semester.) So we 
must show that if t n —* 0 then <F(/i, t n ) —> <l>(yU, 0), or 


exp 


e ltnX _ i _ tf nX 


x 


2 



->• 1 . 


However by the bound 


we obtain 


1 — ix\ < 


x 


2 ’ 


D lt n x _ 1 — it nX 


X* 


dyu(x) 


< 


| tn 


-/i(M) —y 0 , 


so $(/i, t) is a characteristic function. 

This means that if X n is a variable with characteristic function <h(p, n ,f) then X n X, 
where A" has characteristic function $(yU, t). We can compute the mean and variance of A" 
as follows. First the second moment is finite by Fatou: 


EA^ 2 < liminf EA 2 = liminf /x n (M) < oo . 

n n 


Since A" has two moments, we can compute them by taking derivatives of the characteristic 
function: 


df 


exp 


e ltx — 1 — itx 


x z 


d n(x] 


t =o 


d 

df 


e ltx — 1 — itx 


x A 


d n(x) 


= i 


gltX _ ^ 


X 


d/j.(x] 


l t=o 
= 0 . 


t =o 


(Some care needs to be taken with the above computation, in particular being able to pass 
the derivative through the integral. You can check this.) Similarly, we can compute 


d . 
d ~t 


g itx _ 


X 


dyu(x) 


= - / e ltx d fi(x) 


t =o 


= -M®) 


t =0 


This means Var Y = n(R). 


□ 
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Not only is a characteristic function, the associated distribution is infinitely di¬ 

visible: 

Definition 5.2. A distribution p is infinitely divisible if for each n > 1, we can find a 
distribution p n such that 

h = An * ■■■ * hn , 

where the right side is a convolution of n copies of p n . 

Equivalently, a distribution p of a random variable X is infinitely divisible if for each n, 
we can decompose X as a sum of n i.i.d. copies of another variable X n . Equivalently, if 
the characteristic function of p is f> then we can find another characteristic function <f n such 
that f> = 

Theorem 5.3 (Characterization theorem). Y is infinitely divisible with mean zero and finite 
variance if and only if there is a finite measure p such that 

fait) = $ 0 m ) • 

Proof. Suppose that fr(t) = Then for any n, &(p,t) — ®{p/ n ,t) n , so since all of 

these are characteristic functions, the distribution of Y is infinitely divisible and Y has mean 
zero and variance yu(M) < oo. 

Next time we will prove the converse. □ 

Lecture 6 

Last time we proved one direction of: 

Theorem 5.4 (Characterization theorem). Y is infinitely divisible with mean zero and finite 
variance if and only if there is a finite measure p such that 

frit) = $0M) • 

Proof. Now we prove the other direction. Conversely suppose that Y is infinitely divisible 
with mean zero and finite variance. Then for each n. let X n; i,..., X n>n be an i.i.d. sequence 
such that X n>1 + • • • + X n ^ n has the same distribution as Y. The array (A" n y : n > 1, k = 
1,... , n) then satisfies the conditions for the triangular array limit theorem: 

1. Since Y has two moments, X n l + • • • + X n n has two moments. We deduce from this 
that each X n ^ has two moments. To do this, we prove that if X and Z are independent 
and X + Z has two moments, then so does A" and Z. 

Proof. X 2 + Z 2 < (X + Z) 2 + 2\XZ\, so since (A" + Z) 2 is integrable, we need only 
show that \XZ\ is integrable. By Fubini, we can show that |A| and | Z are integrable. 
If |A| were not integrable, then because |A| < \X + z\ + \z\, we would have |X + z 
not integrable for each z. This, by Fubini, would imply that \X + Z\ is not integrable, 
which contradicts (A + Z) 2 integrable. □ 
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2. Each X n k has two moments, so it has one moment. By the i.i.d. assumption, we have 
nEX Hi k = Ey = 0, so EX^, = 0. Furthermore, 


ma 


Var X n i 
Var Y 


1 /n —» 0 . 


Finally, 


sup s 2 = sup Ey 2 = Var Y < oo . 

n n 


Since =>■ y (in fact, all the row sums S n have the same distribution - that of Y), Y has 
characteristic function $(/x, f) for some finite measure /i and is thus inhnitely divisible. □ 

To hnish, let us state another theorem about the representation (without proof). It can 
be useful to find the measure // in the characteristic function $(/x,t). The reason is: 

Theorem 5.5. Let (X n ),X be infinitely divisible with mean zero and finite variance and 
characteristic functions $(fj, n ,t), $(/x, t). Then X n =>■ X if and only if fi n converges to /i 
vaguely. 


Proof. See the proof in Billingsley, Theorem 28.4. 


□ 


• In the case that X is normal, we have /i = Sq. So if we have a triangular array satisfying 
the conditions from the previous lectures: 

sup s 2 < oo and maxja 2 ^ ..., a 2 ^} 0 , 

n 

the Poissonized row sum (at level n) has characteristic function $(/x n ,t), where 


ox 

A*n(- 00,x\ y2 dF 'X(y) ■ 

k =1 00 


When s 2 = 1 for all n, we have jx n —> do vaguely if and only if 



y 2 d F n<k (y) 0 


5 


YEX nJe l{\x n . k \>e ->■ 0 ! 

fc=l 

which is Lindeberg. 
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6 Derivatives and conditional probability 


6.1 Conditional expectation 


We will begin by talking about conditional expectation. Recall the “basic” definition of 
conditional probability from last semester: if P(A) > 0 then the probability P (B \ A) is 
defined as 


P (B | A) 


P(Bfld) 

P(A) 


We can make a similar definition of conditional expectation. If X is an integrable random 
variable with P(A) > 0 then we can give a “basic” definition of conditional expectation as 


E(X | A) 


EV 1^4 
P(A) 


Note that in the case X — 1 b this definition reduces to that of the conditional probability 


P (B | A). 

Now we will give the real definition of conditional expectation, and from this we will 
define conditional probability. As you can see above, one main problem with the basic 
definition is that it makes no sense if P(A) = 0. We will give definitions which essentially 
deal with this problem, and also quite greatly expand the scope of the concept. 

The first difference is that, although the basic definition of condition expectation gives 
a number, our real definition will give a function. To get an idea of how this could happen, 
consider an intermediate case: if 0 < P(A) < 1 and X is integrable, we can define a function 
/ : Q —> M by 


/M 


EXIa 
P (A) 
l^c 
P(A C ) 


if uj G A 
if u e A c 


This is a step function which takes the value from the basic definition on each piece A and 
A c of the space. 

The second difference is that we will not condition on events any more; we will condition 
on sigma-algebras. The function / defined above corresponds to conditioning on the sigma- 
algebra generated by the event A. In other words, we are assuming that the observer of our 
experiment (whose outcome is modeled by c o) knows all information contained in this sigma- 
algebra, but no more: they know if u G A or if u G A c . Then the observer can determine 
the expectation of X given their information. To condition on general sigma-algebras is 
considerably more involved, but the method will also allow to deal with sets of measure zero. 

So my advice is to first absorb the definitions, learn their properties, and how to manip¬ 
ulate them. Later on, we will relate our definition to the basic ones. 


Definition 6.1. Let (Q,E,P) be a probability space with X an integrable random variable 
and T a sub-sigma-algebra o/E. The conditional expectation E[X | J 7 ] is the unique (up to 
measure zero) random variable such that 

1. E[A | J r ] is measurable relative to T and 
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2. for all events A e IF. one has 


E[X1 A ] = E\E[X\IF]1 A ] . 


Written in terms of integrals, 


X dF = [ E[X | J 7 } 

Ja 


( 7 ) 


If Y is another random variable, we define E[A" | Y] to be E[A" j <r(T)]. 

Theorem 6.2 (Existence and uniqueness). Given X integrable and T a sub-sigma-algebra 
of E, there exists an (almost surely) unique IF-measurable random variable satisfying (7). 

Proof. We will apply the Radon-Nikodym theorem. 

Lemma 6.3 (Radon-Nikodym). Let /i be a finite measure on (fl, E) that is absolutely con¬ 
tinuous relative to P; that is, for all A with P(A) = 0, we have n(A) = 0. Then there exists 
a E- measurable, integrable (relative to F) function f : H —> M such that 

iAA) = j f dF for all A e E . 

Ja 

Furthermore for any f,g satisfying the above, we have f = g P -almost surely. 

To be continued. □ 


Lecture 7 


We were proving: 

Theorem 6.4 (Existence and uniqueness). Given X integrable and T a sub-sigma-algebra 
of S 7 there exists an (almost surely) unique IF-measurable random variable satisfying 

I E[X | IF] dF = [ X dF, A e IF . 

Ja J a 

Proof. We now apply the Radon-Nikodym theorem in our context. We can define the mea¬ 
sure P only on IF: that is, we set Pjr : IF — » [0,1] by 

Pjr(A) = P(A) for A e IF . 

Furthermore, define v + : IF —> [0,1] by 

u+(A) = [ X + dP . 

Ja 

Because X + is non-negative and integrable, u + is a finite measure. Furthermore, it is abso¬ 
lutely continuous relative to Pjf: if A E IF satisfies Pjr-(A) = 0 then P(A) = 0 and therefore 
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v+(A) = J A X + dP = 0. So by Radon-Nikodym, we can find a function f : Q R that is 
integrable relative to Pjr and measurable relative to X such that 


X + dP = u + (A) = fdPr= f lu dPj- 


J A JA J 

But one can check that for any ^-measurable function Y that is integrable relative to Pj-, 
one has f Y dPjr = f Y dP (begin with indicator functions, then simple functions, then take 
limits). This means in particular that Y is P-integrable. So we obtain 


AT dP 


/ dP for A e X 


J A J A 

and / satisfies the conditions of the theorem with X replaced by X + . 

We can then repeat the construction with AT to obtain g which is integrable and mea¬ 
surable relative to X such that 



X_ dP 



dP for A e X . 


Now setting E[A" X] = f — g we are done with existence. 

For uniqueness, we simply appeal to the result we proved last semester. If h, k : hi —> M 
are integrable such that 


h 


k dP for all A E E 


JA J A 

then h — k almost surely. Apply this to the measure Pjr on the sigma-algebra T to obtain 
uniqueness. □ 


The value of E[X | T\ is to be interpreted as follows. Suppose an observer knows all 
information contained in the sub-sigma-algebra T. Then, although your best guess for the 
value of X on the outcome u is EAT (since you have no information), the observer’s best 
guess for the value of X on the outcome oj is E[A | X]{uj). 


Properties of conditional expectation. Here we give many properties. Working through 
them will give you an idea of the mechanics of conditional expectation. For all of these 
properties, let X, Y and X n be integrable for each n and T a sub-sigma-algebra of E. 

1. (Linearity) If a, b G M then almost surely 

E[aX + bY | X] = aE[X \ X] + bE[X \ X] . 


Proof. Let A G X. Then 

[ (aX + bY) dP = a [ X dP + b [ Y dP 

J A J A J A 

= a f E[X | X] dP + b I E[F | X\ 

J A J A 

= [ (aE[X | X] + bE[Y \ X}) dP . 

J A 

By uniqueness of conditional expectation, we obtain the result. 


□ 
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2. If X is itself ^-measurable and XY is integrable then E [XY \ F} = XE [Y \ F}. In 
this case, the observer learns the full value of X from their information F. 

Proof. First take X — 1b for some B E F. Take A E F arbitrary and compute 
[ XY dP = / Y dP = / E[Y | F\ dP . 

J A J ArB J ArB 

The last equality holds because A fl B E T. This equals J A XE [Y \ F] dP, and 
completes the proof in this case. 

For any nonnegative simple variable X = JA a.; 1a, for A t E F we use linearity and the 
previous case to find 


E[X7 | F\ = .E[X | F] = YE[X | F] . 

i i 


If X is nonnegative and J r -measurable, we can write it as a monotone limit of simple 
^-measurable functions (S n ). For A E F, use monotone convergence: 

[ XY + dP = / lim S n Y+ dP = lim [ S n E[Y + \ F] dP = [ XE[Y + \ F] dP . 

J A J A n n J A J A 

This means E[A"y + j F] = A"E[F' + | F}. By linearity, 

E[XY | F] = XE[F | F\ , 

and this completes the case X > 0. For the general case of X integrable, just split 
X = X + — X_ and use linearity. □ 

3. If X = a almost surely then E[X F] — a almost surely. 

Proof. Take Y = 1 in the previous property, noting that since X is constant, it is 
X-measurable. □ 

4. If X is independent of F then E[AT | F] = EX’. In particular, E[X | {0, fl}] = EX. In 
this case, the observer learns nothing from their information F. 

Proof. For A E F, 

j X dP = E[X1 a ] = EXP(A) = EX f dP = / (EX) dP . 

JA J A J A 


□ 


Lecture 8 
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We continue with properties of conditional expectation. 

1. If X < Y almost surely then E[A" | X] < E[F | X] almost surely. 

Proof. Suppose it is false, so that the event 

A : = {E[X | X] - E\Y | X] > 0 } 

has positive probability. Note that A e X since the variable E[A" | X] — E[Y | X] is 
J-’-measurable. Therefore 

0 < [ (E[X | X\ — E[y | X]) dP . 

J A 

By linearity of conditional expectation, the integrand is E[X — Y X], so we obtain 

0 < [ (X - Y) dP . 

J A 

But X < Y almost surely, so (X — Y)1a < 0 almost surely and this is a contradiction. 

□ 


2. \E[X \X}\< E[|AT| | X\. 

Proof. This follows since X < X and —X < \X\. Then apply the last property. □ 

3. (Dominated convergence) If X n —y X almost surely, | X n < Y for all n, then E [X n \ 
X] —> E[A" | X] almost surely. 

Proof. Setting Z n = E[A n | X\ and Z — E[X | X], we must show that Z n -A- Z almost 
surely. Assume first that X = 0 and that X n decreases point wise to 0. In this case, 
we must show that Z n —y 0 almost surely. By the previous monotonicity property, 
Z n+ 1 < Z n almost surely for all n so if Z n does not converge to 0, we can find e > 0 
such that 

P (Z n > e for all n) > e . 

Calling this event A, it is A-measurable and so using dominated convergence, 

J Z n dP = J 1 aX h dP —> 0 , 

a contradiction since f A Z n dP > e 2 for all n. Thus Z n —> 0 almost surely. 

To deal with the general case, define 

U n = sup \X n - X\ , 

k>n 

so that U n decreases to 0 almost surely. Since U n < 2 Y we can use the previous case 
to say that E [U n \ X] —> 0 almost surely. But now 

|E[X n | X] - E[X | X}\ < E[|X n - X\ | X] < E[U n \ X\ ->■ 0 

almost surely and we are done. □ 
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4. (Jensen’s inequality) Let 0 : M —> M be convex and assume 0(X) is integrable. Then 

0 (E[X | IF]) < E [0(X) | IF] almost surely . 

Proof. The proof is similar to the unconditional version and uses the fact that for each 
xq G R. we can find a number a such that 

4>(xq) + (x — x 0 )a < 4>(x) for all 

This is a rephrasing of the fact that there is a supporting line for the graph of 0 at 
each point. We may choose a = a(x o) to be the right derivative of 0 at xq. So with 
this choice, taking xo = E[X | IF], we get for almost every u, 

0 (E[X | IF]) + (X - E[X | X])a(E[X | IF]) < 0(X) . 

Assuming first that E[X j IF] is almost surely bounded, then all the terms above are 
integrable and we can take expected value conditioned on IF on both sides. The first 
term is, using J-’-measurability, 

E [0 (E[X | IF]) | IF] = 0 (E[X | IF]) . 

The second is 

E [(X - E[X | X])E[X j IF] | IF] = 0 

and the third is E [0(X) | J 7 ]. We then obtain the statement of Jensen’s inequality. 
For unbounded E[X IF], we just approximate, setting 

G n = {|E[X | IF]\ <n} . 

XIa n satishes the conditions of the previous case, so we can apply it to obtain 

<t>(E[Xlc n | T}) < E\4.(Xl a J | T] . 

The left side equals 0 (lg n E[A" | IF]) and converges point wise to 0 (E[X | IF]). For the 
right side, since X is integrable and 1 a n —> 1, 

XIa n —>■ X, so 0(X 1 g„) —* 0(A") almost surely . 

Again, since X is integrable and dominates XI c n , we can apply dominated convergence 
conditionally for 

E[0(X1 g J I IF] E[0(X) I IF] 

and we are done. □ 


Lecture 9 

We continue with properties of conditional expectation. 
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1. (Tower property) If Q is a sub-sigma-algebra of T then 


E \E[X | J 7 ] | Q] = E[X | Q) . 

Proof. Set Z = E[X \ Q] and W = E[X \ J r ], We need to show that 



E [W 

1 0\ = Z, 

or that for all A £ (j, 


/ Z dP 

= W dP 

But this is the same as 

J A 

J A 


/ E[X | Q) dP = / X dP = / E[X \ J 7 ] dP , 

J A J A J A 

which holds since A £ J 7 . □ 

6.2 Conditional probability 

Conditional probability is just a special case of conditional expectation. 

Definition 6.5. Let J 7 be a sub-sigma-algebra of E and A e E be an event. Define the 
conditional probability of A given J 7 as 

P (A j J 7 ) = E[1 a | J 7 } ■ 

Note that conditional probability is also a function, not a number. The theorem below 
says that conditional probability acts as a probability measure for almost every to. We will 
state a precise version of this later, but at this point we will only prove a functional version. 

Theorem 6.6. With probability one, 

P(0 | J 7 ) = 0, P(fi | J 7 ) = 1 and 0 < P(d | J 7 ) < 1 . 

Furthermore if A\, A 2 , ... are pairwise disjoint, 

P (U n A n | J 7 ) — P (An I J 7 ) . 

n 

Proof. The first statements are the same as 

E[0 | J 7 } = 0, E[1 | J 7 ] = 1 and 0 < E[1 A \ J 7 ] < 1 . 

These follow from the properties of last section. The second statement uses the fact that if 
the An s are disjoint, then 

P(U n A n | J 7 ) = E[l UnAn | J 7 } = E[^C i An | jr] 
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and by linearity this equals 


E E io„ ^ = E p ^» i ■ 

n n 

□ 


Here are some more natural properties. 

1. If A C B then P(H | J r ) < P (B \ J 7 ) almost surely. 

Proof. This follows from last section, using 1a < 1b almost surely. □ 

2. If (A n ) is a nested increasing sequence then P(H n | J 7 ) f P(U n A n | J 7 ). 

Proof. Use conditional dominated convergence with |1^J < 1, which is integrable. □ 

The next theorem says that we can write conditional probability as a true probability 
measure, for almost every uj. In other words, it allows us to fix almost any uj and claim that 
P(- | F){uj) is a probability measure. It requires some properties of the underlying space 0, 
so we will take it to be M. 

Theorem 6.7. Let P be a Borel probability measure on M and J 7 a sub-sigma-algebra of the 
Borel sets. There exists a function p : Q x B —> [0,1], where B is the Borel subsets ofR such 
that 

1. Pui{-) = •) : B —>■ [0,1] is a Borel probability measure on (M, J 7 ) for every uj E LI. 

2. For each A e B, 

p(-,A) = P(H | J 7 ) almost surely . 

Proof. We would like to define a measure p^A) as P(H | ^(ca) for each A. However there 
are (usually) uncountably many H’s and these conditional probabilities are only defined 
almost surely, so it is not clear how to define this simultaneously for all H’s. So we look at 
a generating collection of H’s, of the form (—oo,r] for rational r. 

For each rational r, define 


F(r,u>) = P((—oo,r] | J 7 ) . 

Specifically, for fixed r, we define F(r,uj ) to be a version of the conditional expectation on 
the right. That is, it is defined on all of = R but agrees with the conditional probability 
almost surely. We will now work to show that there is a set of probability one on which the 
F(r, ujfs define probability measures. 

By monotonicity of conditional probability, for each rational r < s we can find a set A rtS 
of probability one such that for uj G A r ^ s , we have F(r,uj) < F(s,uj). Furthermore, for each 
fixed rational r, 

limF(r + n _1 ,u;) = limP((—oo, r + n~ l ] \ J 7 ) = P((—oc, r] | J 7 ) = F(r,uj) 
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almost surely. Therefore we can find an event B r of probability one such that for u G B r , 
we have F{r + n~ 1 ,uj) F(r,uu). Last, we can find an event C of probability one such that 
for oj G C, 

lim F(r,uj) = 0 and lim F(r,co) = 1 . (8) 

r —>—oo r—>oo 

Define 

E = n r ,«A iS Pi n r B r P c . 

By the above arguments, for oj G E, which is an event of probability one, the function 
r i—>■ F(r,uu) (for rational r) is right-continuous, non-decreasing and satisfies (8). Therefore, 
just as in the proof of Helly’s selection theorem, if we define for oj G E 


G(x,lj) = inf {F(r,u>) : r > x} , 

then x i —^ G(x,lo ) is a distribution function of some probability measure / 4 y that is, 

oo, x]) = G(x,u) for x G M and uj G E . 

We must now show that if we define 


= lluJ€E 
V ; \6 0 if u<£E 

then this function satisfies the conditions of the theorem. We will do this next time. 


□ 


Lecture fO 


We were in the middle of proving 

Theorem 6.8. Let P be a Borel probability measure on M and T a sub-sigma-algebra of the 
Borel sets. There exists a function n : Ox B —>■ [0,1], where B is the Borel subsets ofR such 
that 

1. /Uj(-) = fj,(u j, •) : B —> [0,1] is a Borel probability measure on (M, F) for every w G fi. 

2. For each A G B, 

fi(-, A ) = P(t4 | F) almost surely . 


Proof. So far we have defined F(r , u) as a version: 

F(r, u) = P((—oo,r] | F) . 

On a set E of probability one, we have defined as a probability measure with distribu¬ 
tion function G(r, oj) that agrees with F(r,uj) on rationals. We then set 


p(uj,A) 


PbJ (-' 4 ) 

5o 
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if uj G E 
if u ^ E 



and must show that this function satisfies the conditions of the theorem. 
To do this, we will first prove that 


to 1 —y n(to, A) is J r -measurable for all Borel A C M . 


( 9 ) 


In that vein, first note that the collection C of Borel A such that to H > fi(to, A) is ^-measurable 
is a A-system. To check this, first note that G C since 

/i(ca, fl) = 1 for all to 


if to G E 
if to G E 


1 - fj. u (A) 
1 — <5o(Al) 


if to G E 
if to G E 


and is thus ^-'-measurable. Furthermore if A E C then 
h(uj,A c ) = 

and is ^-measurable. Last, if Ai, A 2 ,... GC are pairwise disjoint then 



= 1 -/x(t 0,A) 


hw (A n A r 
{y^nA n 


if to G E 
if to G E 


Y2n ^ui{A r 


if to £ E 
if to G E 


^2fi(u,A r 


and again is ^-'-measurable. 

For every rational r, (—oo,r] G C. Indeed, for to £ E, 


h(uj, (-oo, r]) = G(u, r) = F(u, r) , 


and this equals P((—oo,r] | E) almost surely (and this is an J-’-measurable function). Since 
E has probability one, we have shown that (—oo,r] G C. The collection of such intervals 
is a 7r-system that generates the Borel sigma-algebra, so by the n-X theorem, C contains all 
Borel sets. In other words, (9) holds. 

By definition, for B G T and A = (—oo,r] for r rational, 


P(dflB) = / F(r,uj) dP = / /i(ca,AL)dP. 

J B JB 

For fixed B, both sides of this equation are measures (as a function of A). You can check 
this for the right side. Since they agree on the 7r-system of intervals (— oo,r] for rational r, 
they must agree on all Borel sets. (Again by 7r-A.) 

□ 


6.3 Conditional distributions of random variables 

One way to rephrase our result on conditional probability distributions is in terms of random 
variables. Given a random vector (X, Y), we can find a family /j^ of probability measures 
on M, defined for each to G 0 such that 

fi(oo,A) = P(A" G A | Y)(to) almost surely . 

This family of measures can be called the conditional distribution of X given Y (and can be 
proved exactly the same way). There is a version for conditional expectations. 
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Theorem 6.9. Let (A", Y) be a random vector and f : M —* M be a Borel function such that 
E/(X) exists. If is a conditional distribution of X given Y, then 

j f(x) n(co, dx) = E[/(X) | Y] almost surely . 

Proof. If / is the indicator of a Borel set, then this formula holds by the previous result. 
We can then use linearity to extend to simple functions, then take monotone limits for 
nonnegative functions. Last, split into positive and negative parts for general functions. □ 

Billingsley remarks that one can use this theorem to give a short proof of Jensen. Just 
apply the inequality to the integral above. 

Lecture 11 


7 Examples, applications 

7.1 Basic probability spaces 

We begin with the simplest case. Suppose that (12, E,P) is a probability space and J 7 is a 
sub-sigma-algebra that is generated by a countable partition (Aj) of subsets of 12. This is 
the case, for example, when the probability space is finite or countable: 12 = {1,2,...} or 
when T is generated by a discrete random variable. 

In this case, we expect the new definition of conditional probability to coincide with the 
old (once we modify it to be referring to functions). So let A E £ and define 


fH 


if u G Ai and P(A) > 0 
0 if (X G Ai and P(A;) = 0 


Because (Af) is a partition of 12, / is defined for all c o. Furthermore, the sets on which / is 
defined as 0 have probability zero, so the definition there does not really matter. That is, 
the values there will not affect whether / is a version of P(A | J 7 ). 

We will now show that / = P(A | IF) almost surely. To do this, let B G J-. If B = Ai for 
some i with P(Aj) > 0, then 


J b f dP = = P(A nA) = l 4 dP . 

Otherwise if P(A) = 0 then 

f f dP = 0 = [ 1 A dP . 

Jb Jb 

Therefore the above equation holds for all B e {^4*} and since such B's form a 7r-system 
that generate IF, it holds for all B e IF. (This is because, as in the last section, the set of 
B's for which the above equation holds form a A-system.) 
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To finish the proof we must show that / is ^-'-measurable. But we have already proved in 
the homework that a function is T -measurable if and only if it is constant on the partition 
elements that generate T. This is true for our /, so 

/ = P(H | T) almost surely . 

Example. Let Ah,... be a sequence of simple random variables with values in M. Recall 
that (A n ) is a Markov chain if for each n > 1 and each choice of q,..., i n , i n+ \ E M, 

lP(^n+l ^n +1 | X n i n , . . . , X i fl) P(A n _|_i in +1 | X n in) • 

(Here we are using the old, “basic” definition of conditional probability. We can relate this 
Markov property to our current definition of conditional probability. Set X n = a(X i,..., X n ). 
This sigma-algebra is generated by a countable partition. Namely, if R{ is the range of X l} 
then we can use the partition 

{{Ah = h, ..., X n = i n } : i 3 E Rj for all j} . 

Writing X [) n = a(X n ), we can generate J 7 ® with a different partition 

in\ • i’n E R n } . 


We claim that for Borel H CK, 

P(AT„ + i G H | X n ) = P(X n+1 G H | J 7 ®) almost surely . 

Indeed, any u in our space is in one of the sets {Ah — ii,, X n = i n }, which is a subset of 
{X n = i n }. For such an u, if P(AR = H,..., X n = i n ) > 0, 


1P(A" n _)_i E H \ J- n ) — P(A" n+ i G H | X\ — ii,..., X n — i n ) 


and 

P(X n+1 G H | X° n ) = P(X n+1 EH \X n = i n ) . 

The Markov property says these are equal. 

7.2 The general case 

Example. Densities on M 2 . 

In many basic probability classes, one learns the definition of conditional probability 
for continuous distributions. We will derive the formula here. Suppose that f(x,y ) is a 
density (relative to Lebesgue measure) for a probability distribution P on M 2 . Let T be the 
sigma-algebra generated by the first coordinate x. That is, 


T = cr(x) = a ({A xRAcK Borel}) . 



We claim that for Borcl B cl, 


P (y e B \ x) := P (y G B \ J-) 


S B f(x,y) d y 
f f(x,y) d y 


for P a.e. x . 


In other words, to obtain the conditional probability distribution, we just plug in the value 
of x and normalize. 

To prove this, let A C M be Borel and define (j) by 


(j)(x,y) 


TWWW « / /(rr, y) dy > 0 
o if J f{x,y) dy = 0 


Note that this function only depends on x, so it is measurable relative to T. We must then 
show 

P1axm</>(t, y) = PIaxrIrxb • 

The left side is, by Fubini, 


<i>(x,y)f{x,y) d y da; 


And this equals the right side. 



}{x,y) d y 


da; . 
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More examples of conditional probability: 

Example. Here is a generalization of the last example. Let X, Y be independent random 
vectors of dimensions n± and ri2 respectively, with ri\ + n 2 = n. Then, by Fubini, the 
distribution of (X, Y) is a product measure fi = Hi x /a 2 , where /q is a probability measure 
on M" 1 and is a probability measure on M na , and we proved last semester that 

H(A) = j ni{x G R ni : (x, Y(ui)) G A} dP, A C M n Borel . 

We will show that this implies that 

P((X,F) G A I y)(w) = ih{x G M ni : (a;,F(w)) G A} . 

In other words, we fix the value of Y to be y = Y{u) and take the probability of the set of 
u/ such that (X(uo'),y) G A. 

To do this, we must show that for B C M ma Borel, 

[ l{(x,Y)eA} dP = [ Hi{x G M ni : (t,F( w )) e A} dP . 

J{YeB} J{YeB} 

The left side equals 

fi(A n (M mi x B)) . 
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On the other hand, the right side equals 

J ^i{x G M” 1 : (x,Y (ta)) G A)l{y( w ) eS } dP . 

Now for all u, 

H\{x G BO 1 : (ay Y (cu)) G AjTjy^g^} = /^i{A G BO 1 : (ay Y (ca)) G A fl (BA 1 x B )} . 

So we get 

J in{xe R ni : (ay Y(u>)) G A O (M ni x B )} dP = /i(A n (M ni x B )) , 

which is the left side. In other words, if we “condition on Y = y v for independent random 
vectors X, Y, then we can just place the value y in for Y. 

Example. (Markov process) A collection of random variables (X t : t > 0) is called a 
(continuous time) Markov process if for all t < t' and Borel H cR, 

R{X t / G H | X s , 0 < s < t) = P(AV G H \ X t ) almost surely . (10) 

The sigma-algebra on the left is the one generated by all X s ’s up to time f; that is, it is 

a (X s : 0 < s <t) . 

One can show that this Markov property is equivalent to the following: for every 0 < t\ < 
t 2 < ■ ■ ■ < tk = t < t', one has 

P(AV G H | X tl ,.. ,,,X tk ) = P(AV G H \ X tk ) almost surely . (11) 

To prove that (10) is equivalent to (11), first assume (10). Set A = {X t i G H}, Xi = 

cr(X s : 0 < s < t) and for fixed 0 < fi < t 2 < • ■ ■ < tk — t < t', set X 2 — cr(X tl ,..., X tk ). By 
the Tower property, since X 2 C Xi, 

P {A | X 2 ) = E(P(A | Xi) | X 2 ) = E(P(A | X t ) \ X 2 ) = P (A \ X t ) . 

Conversely, assume (11). Note that the union 

|J 

is a 7r-system that generates <j(X s : 0 < s < t). Furthermore by (11), for each A in this 
union, 

[ 1 {Xt ,eH} dP = / R{X t , G H \ X t ) dP . 

J A J A 

Because the set of A which satisfy this identity forms a A-system, it must then hold for all 
A G (t(X s : 0 < s < t) and we have shown (10). 
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As an example, we can show that a Poisson process is a continuous time Markov process. 
Recall that N t is defined as follows: let Xi,X 2 ,... be an i.i.d. sequence of exponential 
random variables with parameter a > 0. Then we set X (J = 0 and 

N t = mirijn > 0 : X 0 + • • • + X n > t} . 

We showed last semester that 

1. for 0 < t\ < t 2 < ■ ■ ■ < tk, the increments N t2 — N tl ,..., N tk — AT tfc _ 1 are independent 
and 

2. for 0 < s < t, N t — N s has Poisson distribution with parameter a(t — s). 

Using these results, we can show the Markov property by verifying (11). Let 0 < ti < • • • < 
tk — t < t' and let H C M be Borel. Then 

P(-/V t / G H | N tl ,..., N tk ) — ¥((N tl , —, N tk , N t i — N t ) e A \ N tl ,..., N tk ) , 

where A C M fc+1 is the set of points (aq,..., Xk+i) such that Xk+\ + Xk € H. Because 
N t > — N t is independent of the random vector (N tl ,..., N tk ), we can use the result of a 
previous example to write this as a function of u as 


P(o/ : {NtM, • • •, N tk (u), N t ,(<J) - N t {<J)) G A) 


and this equals 

P(w' : (N tk (u),N t ,(u') - N t (u}')) G A) , 

where A C l 2 is the set of (aq,^) such that X\ + x 2 G H. Again, by independence, this 
equals 

P {{N t , Nt, -N t )eA | N t ) = P (N t , E H \ N t ) . 
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8 Martingales 

Martingales can be viewed in many different ways and the first view we will take is that 
they are an extension of independent sums. To see their defining property, let A 1; A 2 ,... be 
independent and with mean zero. We will think as in the gambling example that A n is the 
amount of money we win at time n (that is, at the n-th round of our gambling game) when 
we bet 1 dollar per round. Then our cumulative wealth at time n is 

X n — Ai • • • A A ,2 with -\() — () . 

Now we will use the theory of conditional probability. Let Xq = {0,11} be the trivial sigma 
algebra (the information we have at time 0) and 

T n = a(X i,..., X n ) for n> 1 
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be the information we have at time n. We can then compute the conditional expectation 


E[X n+ i | X n ] = E[X n + A n _|_i | i n.] 

= E[X n | Jb] + E[A n+ i | Jb] . 

Now X n is ^-measurable and A n+ i is independent of T n . So this reduces to 

E[Ab+i | J- n ] — X n + EA n+ i = X n . 

The way to interpret this is that the game is fair ; that is, given our information up to time 
n, our best guess for our wealth at time n + 1 is just what we currently have: X n . 

A Martingale is just a generalization of a fair game. 

Definition 8.1. A sequence (X n , X n ) of random variables and sigma-algebras is called a 
martingale (or (X n ) is a martingale relative to {Xn)) if the following conditions are met. 

1. E|X n | < oo for all n. 

2. X n is X n -measurable for all n. 

3. E[X n+1 | X n ] = X n almost surely for all n. 

4■ X{) — {0,12} and T n C X n+ \ for all n. 

We say (X n ) is a martingale if it is a martingale relative to some sequence {X n ). 

Here are some remarks on the definition. 

• The condition X n C X n+ \ makes (X n ) a filtration. Because X n is J 7 ,,-measurable for 
all n, we say that (X n ) is adapted to the filtration (X n ). 

• If (X nj X n ) is a martingale then also (X n ,Q n ) is a martingale, where 

Qn = ^(Ab, • • •, X n ) . 

The only condition we need to check is that 

E[A n+l | Xi,... ,X n ] = X n almost surely . 

This holds by the tower property. Indeed, since each of Xi, ..., X n are Jb-measurable, 
it follows that a{ Ab,..., X n ) C T n . Therefore 

E[X n+ i j Xi,, X n ] = E[E[X„ + i | T n \ | Ab,. • •, X n ] 

= E[A n | Ab,...,X n ] 

= Ab, . 
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• By the Tower property again, for n,k > 1, 


E[X n+k [ T n ] = E[E[X n+fc [ T n+fc—l] | <Fn\ = E[A n+fe _i | T n ] . 

Iterating this argument, 

E[A ' n+k | T n ] = E[A n+ i | T n ] = X n . 

• For each n, 

EA n = E[E[A n+ i | T n ]] — EA n+ i . 

Therefore 

EX n = EAo for all n . 

• A martingale difference sequence is defined as 

A n A p X n _i for /i A 1 

where (X n ) is a martingale. If X n is the generalization of an i.i.d. sum, then A n is the 
generalization of the i.i.d. summand. So, to be expected, 

EA n = EA n — EX n _i = 0 . 

Furthermore the martingale property for X n is equivalent to 

E[A n+ i | = X n — X n = 0 almost surely . 

Last, if (X n ) is a martingale such that EA^ < oo for all n then the A„’s are uncorrelated 
(as in an i.i.d. sum). To see this we use the tower property. Take j < k and compute 

EAjA fc = E[E[AjA fc j Tk~ i]] 

= E[AjE[A fc | Tk- 1]] 

= 0 . 

Here we have used that A j is Tk- i -measurable and that E[A^ | Tk- i] = 0. 

Examples. 

1. Let X be integrable and let {T n ) be a hltration. Then defining X n = E[A j T n ], we 
can show that (X n , T n ) is a martingale. Indeed, 

E|A n | = E|E[A | T n \| < E|A| < oo , 

and X n is T n measurable. Last, by the tower property, 

E[X n+ i | T n ] = E[E[X | T n+ 1] | T n ] = E[X \ T n ] = X n . 

So we can always build a martingale by conditioning one variable on a filtration. This 
is called a Doob martingale. It will turn out that in wide generality, we can express a 
martingale X n as E[X | T n ] for some random variable X. 
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2. Let / be a Lebesgue integrable function on [0,1]. Then define f n by 

f n (x) = 2 n r f(t) dt for t G ■ 

J -^rr L / 

Then on the probability space [0,1] with Lebesgue measure, f n is just E[/ | J 7 ,,], where 
T n is generated by the dyadic intervals. Such a sequence is called a dyadic martingale. 
There is an interesting interplay between martingale theory and harmonic analysis 
brought about by analyzing dyadic martingales. 

3. (Branching process) Imagine that at time 1, we have one organism. At time 2, that 
organism dies and gives birth to a random number Z 2 of organisms. At time 3, each 
one of these dies and gives birth to a random number of organisms, the total number 
being Z 3 . We can model this as follows. Let (N nk : n,k > 1) be an i.i.d. array of 
integer valued random variables. Set Z x — 1 and inductively, 

Zn = N n _ 1 ; 1 + • • • + N n _i t z n _ 1 • 

Here N n _ j k is the number of children that the k-th organism (who was born at time 
7i — l) has. 

Suppose that KN n _ k = m. Then we claim that Y n := Z n /m n is a martingale (relative 
to its own filtration). To see why, calculate 

E[Z n | Z x ,..., Z n - 1 ] = EflVfj-ip + • • • + A n _i j ^ n _ 1 j Zi,..., Z n _i] 

OO 

= ^2 ^[(Arn-ip H-h A n _i iZn _ 1 )l( Zti _ 1=fc j I Z x ,..., Z„_ 1 ] 

k =0 

OO 

— 22 ^-{■ Z n-l=fc}®[(^ n - 1 . 1 + ' ' ' + N n -l t k) | Zll ■ ■ ■ 1 Z n -l\ 

k=0 

OO 

= 22 1 {z n -i=k}km = Z n _ym . 

k=0 

Therefore 

E [Xn I bi,..., Y n _ 1 ] = m n E [Z n j Z x ,..., Z n _i] = Y n _ x . 

Lecture 14 

8.1 Submartingales and supermartingales 

The definition of submartingale is similar: 

Definition 8.2. A sequence (X n , iF n ) is a submartingale if 
1. E|X n | < 00 for all n. 
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2. X n is F n -measurable for all n. 

3. E[X n+ i j Frf\ > X n almost surely for all n. 

4■ F 0 = {0, and F n C F n+ i for all n. 

A submartingale represents a gambling game which is at least fair (that is, it may be in 
your favor, but not against you). Here are some corresponding remarks. 

• E X i E E X 2 ft • • • 

• E [X n+k | F n \ > X n . 

• If X n is a martingale and <f> : M —> M is convex with E0(AT n ) < oo for all n, then cj){X n ) 
is a sub mart ingale. 

Proof. By Jensen, 

E [</>{X n+1 ) I F n ] > 0 (E[X n+1 I F n ]) = <f>(X n ) . 

□ 


A supermartingale has the same definition, but with item 4 replaced by 
E[X n+ i | F n \ < X n almost surely for all n . 

There are corresponding remarks (as above, but with signs flipped). 


8.2 Gambling systems revisited 

As in the motivation to martingales above, suppose we play a gambling game where we begin 
with some fortune X 0 and at time n our fortune is X n . Then in the case of a fair game it is 
natural to assert that X n is a martingale. So A n = X n — X n _i for n > 1 is the amount won 
at the n-th game (assuming that 1 dollar is bet). If instead of betting one dollar, one bets 
W n dollars, then the total wealth at time n is 

Y n = Xq + W\A 1 + • • • + W n A n . 


We assume 
information 
Then 


as before that the wager W n made at time n is bounded and depends only on 
up to time n — 1; that is W n is J 7 ,,-measurable (where F n = (^(A'o,..., X n )). 


Y n is still a martingale . 


To see why, just compute 


E[W+i | F n \ — E [Y n | F n ] + E[W n+ iA n+ i | F n,] 
— Yn + Wn+lE[A n+ i | F n \ = Y n . 
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This means that if the game is fair and we make any wagers we want, it is still fair. That 
is, we cannot get any advantage from making strategic bets. 

We can also introduce a stopping time, as in last semester. It is a function 

r:fl->NU { 00 } satisfying {r = n} E T n for all n . 

(One can also define as {r < n} E T n for all n; this is equivalent.) This is a function telling 

if n <t 
if n > t 

This will still be a fair game, meaning that X* is still a martingale, as we will show. To 
verify the definition, first 

oo n —1 

E|X*| = y>|x;|l {r=fc} = ^ E|A" fc |l{r=fc} +E|X n |l{ r > n | 

k= 0 k=0 

n— 1 

< y^E|A fc | + E|X n | < oo . 

k= 0 

Next we show that X* is J r n -measurable. For H cl Borel, 

{X* EH} = [U n k zl{X k G H, t = k}] U (X n EH,T>n}. 

Since X k is X^-measurable, the definition of stopping time gives 

{X k G II. t = k} G T k C T n , 
so the first union is in T n . For the second, 

{ r > n} = [U lzl{r = k}}° E X n -i C T n , 

so since X n is J r n -measurable, the second term of the union is also in T n and we conclude 
that X* is T,, ^measurable. 

Last, 

n 

®[^"n+l I ^n\ = 'y " E[^fcl{T=fc} | J~r ).] + E[X n+ il {r>n+l} I Fn] 

k= 0 
n 

y ^ X k 1 {r=k\ T l{r>n+l}®[^"n+1 | X n.] • 
fc =0 

Here we have used that the terms l{ T =fc}, X k and l{ r > n+ i} are J r n -rrieasurable. By the 
martingale property, this equals 

X k 1 {r=k} T X n l| T > n _|_i| X n . 

k =0 

We conclude yet again that we cannot gain an advantage by stopping when we want. 



us when to stop betting. That is, we define 
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8.3 Stopping times and the stopped sigma-algebra 

The stopped sigma-algebra is defined, for a stopping time r, by 

T t — {A G £ : A fl {t = k} G J-fc for all A;} . 

This definition is quite weird, but it is supposed to be the information that we have at the 
time we stop playing. To understand the definition, we can partition the space fl given by 
the events {r = k } (imagine here that r < oo). On the portion of the space covered by 
{r = k}, T r should represent the information given in T k . So an event should be knowable 
at time r if on each set {r = k}, the piece of A in this set is in Ty.. 

• T r can be equivalently defined as 

T r = {A G £ : A fl (r < k} G Tu for all k} . 

Proof. If A satisfies A fl {r < k} G T k for all k then 

A fl {r = k} = A fl ({r < k} \ {r < k — 1}) = (A fl {r < k}) \ (A fl {r < k — 1}) , 

which is in J 7 *,, since the first is in and the second in i C J r k- 
Conversely, if A satisfies A fl {r = k} e Fk for all k, then 

A fl {r < k} = uj =1 {A fl {r = j}) G T k . 


□ 
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Recall that if r is a stopping time, then the stopped sigma-algebra is defined by 
T t — {A G E : A fl {t = k} G for all k} . 


• T t is a sigma-algebra. 


Proof. First O G J T since {r = k} G T k for all k. Next if A G then for each k , 
A c fl {r = k} = {r = k} \ (A fl {r = k}) and this is in T k . Last if Ai, A 2 ,... G T t then 
for each k , 

(U n A n ) fl {r = k} = U n (. A n fl (r = k}) G T k . 


□ 


• r is ^-measurable. 
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Proof. For any n, 


{r = n} fl {t = k} 


0 if n ^ k 

{t = k} if n — k 


So in all cases, this is in TV- Therefore {r = n} G TV- Since r takes values in NU{oo}, 
this suffices to show that r is TV-measurable. □ 


• If r is identically n then TV = T n . 

Proof. Suppose that r = n. Then {r = k} = 0 when fc^nso in these cases all events 
A satisfy A fl {r = k} G TV- Therefore 

TV = {A : A fl {r = n} G TV} . 

But (r — n} — fl so this is TV- □ 


• If Ti < r 2 pointwise then T r , C TV 2 - 


Proof. Assume Ti < r 2 and let A G TV, • Then for any k, 

A fl (r 2 = fc} = uj =0 [A fl (ti = .)} n (r 2 = fc}] . 

Since A fl {ti = j} G T} C TV and (r 2 = A;} G TV, this is in TV- and we are done. □ 

There are theorems that state that for martingales (and also sometimes for Markov 
processes), stopping times behave like times. One example is the optional stopping theorem. 
In the martingale case, it says roughly that there is nothing to gain by stopping at a stopping 
time. 

Theorem 8.3 (Optional stopping theorem). Let (Ad, TV),..., (X n , T n ) be a submartingale 
and let 1 < T\ < t 2 < n be stopping times. Then 


E[X T2 j TVJ > X T1 . 


If submartingale is changed to martingale then > is changed to =. 

Another way to state the theorem is that the submartingale (or martingale) property 
holds for bounded stopping times. 

Proof. First 

n 

E|Ai r2 | < E|AV| < oo , 

k= 1 
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9 Applications of stopping times 

As applications, we give two important inequalities. The first is an extension of Komogorov’s 
maximal inequality for i.i.d. sums to the martingale setting. Note below that if (X n ) is actu¬ 
ally a martingale, (| X n |) is a submartingale, so the inequality below holds for rnaxi< 8 < n A,|. 

Theorem 9.1 (Maximal inequality). If (X n ) is a submartingale then for a > 0, 

P max X; 

l<i<n 

Proof. Set M k = ma ~x. 1 < i < k X i . Define a by 

a = min{fc = 1,..., n : X k > a} 


> a < — E|X„ 
a 
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and r = minjcr, n}. Then r is a stopping time (and so is a): 


{r = k} 


{X\ < a ,..., Xk-i < a, X k > a} if k < n 
{M n - 1 < a} if k — n 


where (Xk) is the filtration generated by the X^s. 

Note that {M n > a} G T t . This is because for k < n, 


{M n > a} fl {r < k} = {M k < a} , 

which is in For k > n the event {r < k} is just the event so {M n > a} fl{r < k} G T k 
in that case too. So we can use the optional stopping theorem for E[X n j J>] > X T and 
deduce 


Q'P (M n > a) < 


X T 


{M n >a} 


< 


{M n >a} 


E[X n | X T \ dP = / X n dP < E|X n | . 


l{M n >a} 


The first inequality holds because X T > a when M n > a. 

Lecture 16 


□ 


The next inequality is useful for proving martingale convergence theorems. For it, we 
need to define a sequence of up-crossing times. 

Definition 9.2. If X i,X 2 ,... is a sequence of random variables, we say (X n ) has an up- 
crossing of the interval [a, b] between times m < n if 

X m < a but X n > b . 


We would like to count the number of up-crossings of the interval [a, b] for a martingale 
sequence (X n ) between times 1 ,,n. To do this, we introduce stopping times. 


Tl = 


min{i G [l,n] : X, < a} if this set is nonempty 
n otherwise 


This is the first time the sequence drops below a (if it does). Then we set 

minji e [1, n\ : i > T\, X, > b} if this set is nonempty 


t 2 = 


n 


otherwise 


The time interval [ti,t 2 ] corresponds to an up-crossing of [a, b] exactly when X T1 < a and 


X T2 > b. 
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We continue and define inductively: 


for k > 1 , r 2fc 


min{i G [1 ,n] : i > r 2 k- 1, X t > 6} 
n 


if this set is nonempty 
otherwise 


and 


for k > 1, r 2 fc+i 


rnin{?' G [l,n] : i > r 2 fc, A"* < a} 
n 


if this set is nonempty 
otherwise 


You can verify that all the rf s are stopping times. We then define the number of up-crossings 
of [a, b] with a < b until time n as 

u a'i = max 0 : > 1 : X r 2i -1 < a <b< X T2i } . 

If the sequence ( X n ) has many up-crossings of an interval, this means that the sequence 
fluctuates. Therefore to prove that (X n ) converges, we would like to bound the number of 
up-crossings of intervals. 

Theorem 9.3 (Up-crossing inequality). If (X n ) is a submartingale then for a <b, 

Ipv/W < ^l^ n l + H 

a ' b ~ b-a 

Proof. First we will prove a special case. Suppose that a = 0 and X n > 0 for all n. Then, 
since T; < Tj+i whenever r* < n, we must have r n = n. Thus we can write 

n 

Xn = x r „ > X T , - x Tl = V [x Tt - , 

k =2 

Write S e for the sum over the even k 's and S D for the sum over odd fc’s. Note that all the 
up-crossings of [a, b] = [0, b] are recorded in E e and each time there is an up-crossing, the 
difference X Tk — X Tk _ 1 is at least b — a. Furthermore for intervals [r^-i, Tk\ (with k even) that 
do not correspond to an up-crossing we have either Tk-i — Tk — n or Tk-i < n = Tk and in 
both of these scenarios X Tk — X Tk l > 0 (by non negativity of the A, : ’s). Therefore, 

s e > (6 - a)U$ . 


Again by non-negativity of the X n ’s, 

E|A n | = EE e + EE 0 > (b — a)EUf^ + EE 0 . 

On the other hand, for optional stopping and the fact that (X n ) is a submartingale, when k 
is odd, 

- X Tk _f) > EA T)C _ 1 - X Tfc _ 1 = 0 . 
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Therefore EE 0 > 0 and we obtain 

jr(n) < _ E[..Y n | + |g| 

a,b — b — a b — a 

This proves the theorem in our special case. 

For the general case, let (X n ) be a submartingale and suppose that a is not necessarily 
0. Then define Y k by 

Y k = max{0, X k - a} = (j){X k ) , 

where <f>(x) = max{0,a; — a] = [x — a) + . Note that 0 is convex and E| Y k < oo. Furthermore 
by Jensen and monotonicity of 0, (Y n ) is a submartingale: 

E[K„ +1 | X n ] > 0(E[X n+1 | X n ]) > <f>(X n ) = Yn . 

Let V^_ a be the number of up-crossings for (Y k ) until time n on the interval [0,6 — a]. By 
what we have already proved, 


El^( n ) < < ^l^ n l H 

°' b ~ a - 6 - a ~ b-a 

However up-crossings of ( Y n ) on the interval [0, 6 — a] exactly correspond to up-crossings of 
(X n ) on the interval [a, 6], so V^_ a = , and the theorem is proved. □ 

From this theorem it follows immediately that if (X n ) is bounded in L 1 then the number 
of up-crossings of any given interval is finite almost surely. 

Corollary 9.4. If (X n ) is a submartingale and a < b then setting 

U a , h = \imU™ , 

n ’ 

the condition sup n E|X n | < oo implies E U a ^ < oo (and therefore U a ^ < oo almost surely). 
Proof. Since Ujfjj is non-decreasing in n, the monotone convergence theorem gives 

Terr r Tcrr( n ) ^ E|^n| + | a | 

E U a fi = Inn E U) , < sup--- < oo . 

Tl ’ 77 , o a 


□ 


Lecture 17 
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9.1 Martingale convergence theorems 

We now aim to show that L 1 bounded martingales and Doob martingales converge almost 
surely. We begin with L 1 bounded submartingales. 

Theorem 9.5 (Martingale convergence). Let (X n ) be a submartingale with K = sup n E| X n \ < 
oo. Then X n —> X almost surely for some random variable with E|X| < K. 

Proof. This is a direct application of the up-crossing inequality. By the corollary of last 
section, for each a, b , U a ,b < oo almost surely. So 

P (U a fi < oo for all rational a < b) = 1 . 

Note that 

P(liminf X n < lirn sup X n ) < P ( lirn inf X n < a <b < limsupX n 

n n \ n „ 

a<b rational ' 

However if lirn inf n X n < a < b < limsup n X n then U a ^ = oo, so this has probability zero. 
We conclude that lim inf n X n = lim sup n X n almost surely; that is, X n converges to some X. 
By Fatou, 

E\X\< liminf E|X n | < K . 

n 

□ 

Recall now that if A" is an integrable random variable then given a filtration (A),), a Doob 
martingale is defined as X n = E[A" | We can identify the martingale limit in this case. 

Theorem 9.6 (Convergence for Doob martingales). Let X be integrable and (Xn) be a 
filtration. Writing T = o (U„ fF n ), 

X n —> E[AT | X] almost surely . 

Proof. Because 

supEjA^I = supE|E[X | X n ]\ < E|AT| < oo , 

n n 

the martingale convergence theorem gives X n —> Z for some random variable Z with E\Z\ < 
E|AC |. We must show that Z = E[X | X] almost surely and to do this we claim that 

(X n ) is uniformly integrable . (13) 

Assuming we show this, then take A e X m for some m and use uniform integrability to 
obtain 

I Z dP = lim / X n dP = lim / E[A | X n ] dP . 

J A n J A n J A 

For n > m, the fact that A E X m C X n gives 



/ Z cW = lim / X dP = / X 

Ia n Ja Ja 
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These two integrals agree for A in the 7r-system U n T n and so they must agree in the generated 
sigma-algebra T. This shows that Z = E[A" | T\ almost surely. 

To prove the claim, let e > 0. We must show that there exists a > 0 such that 


'{|X n |>a} 


\X n \ dP < e for all n . 


By the definition of X n 
suffice to show that 


E[X | .F n ], we have \X n \ < E[|A"| | X n ] almost surely, so it will 


'{\x„\ > 0 } 


E[\X\ | X n ] dP < e 


and of course, since {| X n > a} G X n , this is the same as 


'{\X n \>a} 


\X\ dP < e for all n 


(14) 


We now use a homework problem from last semester which states that since X G L 1 , we 
can find 6 > 0 such that for any A G E with P(A) < 5, we have 


\X\ dP < e . 


(15) 


By Markov, for any a > 0, 

F(|X n | > a) < -E\X n \ < -E[E[|X| | T n ]\ = -E\X\ . 

CL CL CL 

So choosing a = jjjjyyp tfu s gives that P(|X n | > a) < 5 and so (14) holds. 

• In the case that T = E; that is, the filtration generates the space, then 

E[X | Tn\ —» X almost surely . 


□ 


• If f n is a dyadic martingale; that is, for some / e T 1 ([0,1)), 

k 

f n (x ) = 2” [ fit) dt for x G 

/ fc -1 
2 n 

then /„—>•/ almost everywhere. (Note the similarity to the Lebesgue differentiation 
theorem.) 

• For the branching process Z n with offspring distribution that has mean m, we showed 
before that Z n /m n is a martingale. Note that it is also nonnegative, so 

= supEZ n /m n = E Zi/m = 1 , 

n 

and Z n jm n converges almost surely to some variable Z with E\Z\ < 1. Since m n — y 0 
this means that Z n —> 0. Since Z n is integer valued, Z n = 0 for all large n. In other 
words, if m < 1, the population dies out. 


sup E 


m' 1 


k — 1 k 

2 n ’ 2 n 
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• If (X n ) is an L 1 bounded martingale that converges to X , we need not have X n = 
E[X | Xn]. Indeed, dehne 


if X e [0, 2~ n ) 
if X e [2 _n , 1) 

and let T n be the sigma-algebra in [0,1) generated by the dyadic intervals of width 
2~ n . Then you can check that (/„) is a martingale that is nonnegative (and therefore is 
L 1 bounded) and converges to some /, which in this case is 0. However, f n ^ E[0 | X n ]. 
The ingredient missing here is uniform integrability. 

• If (X n ) is a uniformly integrable martingale, then there is a random variable X G L 1 
such that X n = E[A | X n ] and X n —> X almost surely and in L l . (In other words, 
both statements from the last two theorems hold.) 

Proof. Because ( X n ) is uniformly integrable, sup n E| X n \ < oo and X n converges almost 
surely to some X. So for any m and A e uniform integrability gives 

I X dP = lim / X n dP . 

J A 71 J A 

However for n > m, X m = E [X n j X m ], so the last integral is f A X rn dP. This proves 
that X m = E[X | X m ], □ 



Lecture 18 


10 Exchangeability 

As an application of martingales, we will prove de Finetti’s theorem on exchangeable se¬ 
quences. 

Definition 10.1. A sequence (X n ) of random variables is exchangeable if for each n > 1 
and each permutation a e S n , 

(X 1 ,...,X n ) = (X CT(1) ,..., X a ( n )) in distribution . 

The variables are exchangeable in the sense that we can permute (exchange) any finite 
set of them and leave the distributions unchanged. Here are some examples. 

Examples. 

1. If (X n ) is i.i.d. then it is exchangeable. 
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2. Consider an urn with one white ball and one red ball. At each time we remove a ball 
from the urn and return it with an additional ball of the same color. At time n, let 


Ad 


0 we draw a white ball 
1 we draw a red ball 


We claim the sequence (Ad) is exchangeable. To see why, let n > 1 and let x\, ..., x n <E 
{0,1}. Then 


P(Ad = x u ..., X n = x n ) = J][ 


i —1 


+ hhi_il{ Xi= o} 

Ri -1 + Wi —1 + 2 


where R n is the number of red balls and W n is the number of white balls at time n 
(with R 0 = W 0 = 0. The denominator above is i + 1. The numerator is either Ri-± or 
B£-i depending on whether or not Xi — 1. Because we replace one ball at a time, the 
Ri 1 s for which x^ = 1 increase by one at a time. Therefore 

i? W ' 

P(X 1 =x 1 ,...,X n = x n )= "• - , 

(n + l)n • • • 2 

and this only depends on the numbers R n and W n . (Here R n = Y^i=i x i■) For any 
permutation a, the number x a p) is the same as ]C" =1 x^, so the above probability 

equals P(Ad = x a{1) , ...,X n = x a(n) ). 

3. Here is a more complicated example. Let £ be a random variable supported on [0,1] 
and, conditioned on the value of £, let (Ad,...) be an i.i.d. sequence taking values in 
{0,1} with probabilities 1 — £ and £. We can construct this as follows. Let Yi,Y 2 , ... 
be i.i.d. uniform [0,1] random variables and define (Ad, Ad,...) as a function of the 
sequence (£, Yi, Y 2 ,.. .) as 

X n = 1{Y„<£} • 

We obtain 

P(Ah = X!,..., Ad = I £) = £ E * Xi (l - 0 n " Ei ^ , 

and because this only depends on J2i x i, the sequence is exchangeable. Here we say 
that the sequence is a mixture of Bernoulli sequences. 


In the last example, there is a random variable £ such that, conditional on £, the Ad’s 
are i.i.d. Bernoulli, de Finetti’s theorem says that this is always true. 

Theorem 10.2. Let (Ad) be an exchangeable sequence of (0,1 }-valued random variables. 
There exists a random variable £ such that for all n > 1 and aq,..., x n G (0,1}, 


P(Ah = Xl ,...,X n = x n | £) =f(l- 0 n ~ s 


and 

where s = ]C” = i x t . 


P(Ad = x u ...,X n = x n ) = E£ s (l - 0 n ~ s , 
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Proof. Note that the second equation follows from the first by integrating, so we need only 
prove the first. 

In the construction above of i.i.d. mixtures, we see that (by the law of large numbers) £ 
is actually the asymptotic fraction of l’s in the sequence (X n ). So we will work to condition 
on this. We will do it by taking a large n, conditioning on the fraction of l’s (or number of 
l’s) and finding the conditional distribution of the first m variables, where m is fixed relative 
to n. 

Define S n — X\ + • • • + X n . For a fixed value of t = S n , 

P(5'n = t) = ^ F ( A "l = Xl, . . . ,X n = X n ) . 

xi,...,x n :J2 x i =t 


There are (") number of choices for the xfs and they are all equally likely. Therefore for 
each such choice (that is, each n-tuple (aq,... ,x n ) such that JTaq = t ), 


P(Ad = aq, ..., X n = x n | S n = t) 



For m < n and fixed such that Y^i=i x i = we can sum over fl ie ("_T) 

possible entries x m+ i,..., x n for 


IP(^Y"i • • • 5 'Em | 


fn—m\ 

V t-s ) 

G) 

(n — m)\t\(n — t)\ 

(t — s)!(n — m — t + s)!n! 
[t] s [n - t] m _ s 
p\m 


where [a ]b = a!/(a — 6)!. Divide the top and bottom by n m and rewrite this as 


Setting x = t/n, the first term is 


[t]s \p* t]m—s 


n s 


t(t — 1) • • • (t — s + 1) 
n s 


x(x — 1 /n) ■ ■ • (x 


S— 1 


n 



(s 



- 1)/«) 





1 
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Similarly, 


P t]m—s 


n 1 

m—1 / 

n6- 


— x - 

n 


Therefore 


where 


P(A-i %1 j • • • i X m X m | S n t ) fm,s,n(t/ri) j 


fm,s,n{p) 


na (^imgrT^il 
ns 1 (i - h 


We will finish next time. 


Lecture 19 


We were in the middle of proving: 


Theorem 10.3. Let (X n ) be an exchangeable sequence of {0, 1}-valued random variables. 
There exists a random variable £ such that for all n > 1 and xi,... ,x n G {0,1}, 

p(w = Xl ,..., x n = Xn i o = r (i - o n ~ s 


P(W = x u ..., X n = x n ) = E£ s (1 - o r 


where s = x i- 


Proof. We showed that for m < n and given s, t, 


where 


P(A.l X\, . . . , X m X m | S n t) f m,s,n(f/ri) 


Jm,s,n{X) — rr m_1 (l — i) 

1 L=0 n) 


Because t takes only finitely many many values of t in equation (17), we may rewrite it 


P(A"i = X!, . . . , X m = X m | S n ) = fm,s,n ^ — J ■ 

Note that the entire development above only depended on choosing the value of S n = t. In 
particular, if we also let j > 1 and fix values t±,... ,tj then 


P(Ai x i,..., X m x m | S n f, Sk-i-i f i, • • - , S n +j tj ) f 'm,s,n(t / n) , 
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so long as the event we condition on has positive probability. In other words, 


• • • ? Xm %m | • • • ? ^n+j) fm,s,n y ^ y 

Now we use martingale convergence. Because l{Xi=xi,...,x m =x m } is integrable, we can take a 
limit in j for 

P(Ad =Xi,... 1 X m =X m \T n )= fm,s,n (~ ^ , (18) 


where T n = a(S n ,S n+ 1 , ...). As n grows, the left side is a backward martingale. 

Lemma 10.4. Let X be integrable and dF\ D T-i D ■ ■ ■ be a nested sequence of sub-sigma- 
algebras of X. Then 

E[X | X n ] ~E[X | X] , 

where T = f\ n T n - 

Proof. For any n, the sequence 

Xni Xn—h ■ ■ ■ ■ A1 

is a martingale that is uniformly integrable (thus bounded in L 1 ). Therefore if we pick 
any rational a < b, we can still define the number of up-crossings of [a, b] and E U^jj 
is bounded. Furthermore it is still true that is non-decreasing in n, so by monotone 

convergence, E U a ^ is bounded, where U a ^ = lim n . This implies as before that X n —y Z 
for some integrable Z. Note that Z is measurable relative to each X ni since it is a limit of 
X n , which is measurable relative to T n . So Z is measurable relative to T. 

Now the proof that Z = E[A | T\ is nearly identical to what we showed for (forward) 
martingales under uniform integrability. □ 

Applying the lemma in (18) and taking n —> oo we obtain 


P(Ad = xi, ..., X m = x m | T) = lim f msn — 

n \ n 


(and we are guaranteed the limit on the right exists, since the one on the left did). The 
formula for f rn , n ,s implies that if x n —> x then 

fm,n,s( X n) X s {h ~ x) m ~ S . 

So for a particular u for which lim n /m,s,n(„) exists, if we let f be any limit point of 
(yf : n > m), 

p(Ad = Xl ,...,x m = Xrn \ t) = r(i - o m ~ s • 

If we argue that there is only one limit point f then, since it is T measurable, it is a random 
variable (that is, it is E-measurable) and we will be done. 

If £i(cu) < £ 2 (w) are two different limit points of ( — (a;) : n > m), then we must have 

e;(i-ei) m "' = s(i-6) m “', 
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since they both equal the conditional probability. But since S n has increments of size at most 
1, each number in the interval [£ 1 ,^ 2 ] must also be a limit point and satisfy this equation. 
Therefore the function x 1 —> x s (l — x) m ~ s must be constant for a non degenerate interval of 
ads and this is a contradiction. □ 


11 Stochastic processes 

A stochastic process is simply a collection ( X t ) t eT of random variables defined on the same 
space, indexed by some set T. We have already worked quite a bit with T = N (sequences 
of random variables) but also with T = [0,oo), when we studied the Poisson process. We 
will typically think of T = [0, 00 ) in what follows. The major issue here is that T can be 
uncountable, and we are not so well-equipped with dealing with uncountable collections. 

Definition 11.1. The finite dimensional distributions of a stochastic process ( X t ) is the 
collection of distributions 


{htu-Jk '■ h, ■ ■ ■ fik e T, k> 1} , 
where is the distribution of the vector (X tl ,... ,X tk ). 

We note two properties of the finite dimensional distributions. 

• If k > 1, t \,..., tk € T and a e Sk is a permutation on k letters then for Borcl sets 
H u ...,H k CM, 

x x Hjf) — x • • • x H c r (fc)) • (19) 

This is because each side equals P(X t( e Hi for i — 1,..., k). 

• (Consistency) For k > 1, ti,,-, tk +1 € T, then for Borcl sets H 1 ,..., Hk, 

x • • • x H k ) = x • • • x H k x M) . (20) 

This is because each side equals F(X ti H t for i — 1,..., k and X tk+l e M). 

Now we would like to construct stochastic processes with given finite dimensional distri¬ 
butions. So given a collection M = {fj,t u ... t t k '■ ti, ■ ■ ■, tk G T, k > 1} of measures we ask if 
there is a stochastic process with M as its finite dimensional distributions. Clearly (19) and 
(20) must hold. The theorem of Kolmogorov says that they are sufficient. 

We will prove this theorem, but first let us talk a bit about product spaces again, because 
they will be essential for the construction. 

Lecture 20 

Midterm will be a take home in place of the next homework. 
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11.1 Product spaces 

Definition 11.2. Given a set T, the product space M. T is the set of ‘T-dimensional vectors” 

M r = {x = (. x t )teT : x t £ M for all t} . 

This can be identified with the set of functions from T to M. 

Each element x consists of a collection of numbers x t = x(t), one for each t £ T. For 
each fixed t £ T we can define the coordinate function 

Z t {x) = x t = x(t) . 

The coordinate function is a function of x £ and for fixed t will correspond to an 
individual random variable X t , so we would like it to be measurable. Therefore we define 
our product sigma-algebra when 12 = M. T as 

E = B T = a(Z t :t £ T) . 

In other words, the sigma algebra is generated by the sets {x : x(t) £ H} for Borcl H CK 
and fixed t £ T. 

Note that there are two points of view here. For a fixed x we may allow t to vary. This 
is thinking of re as a function of t and we can picture this as an arbitrary function from T 
to M. For instance, when T = [0, oo), this is the collection of all functions from [0, oo) to M 
(however irregular). When we put a measure on the space, this point of view corresponds 
to thinking of random functions. On the other hand, we may fix t and view the coordinate 
map as a function of x. This point of view will correspond to thinking simply of a collection 
of random variables. 

There is an alternative way to view E, as generated by the finite dimensional cylinders. 

Definition 11.3. For ti ,... ,tk £ T and Borel H e R k , the k-dimensional cylinder corre¬ 
sponding to the ti’s and H is 

{x G M T : (Z tl ( x),Z tk ( x)) £ Hj . 


Proposition 11.4. The collection S 0 consisting of all cylinder sets is an algebra. 

Proof. We must show that 12 G E 0 , that E is closed under complements and that it is closed 
under finite unions. For any t, 

12 = {i:i ( 6l} 

and if for k > 1, ti,..., tk £ T with F[ CK* Borel, 

A = {x : (x tl ,,,.,x tk ) £ H} 

then 

A c = {x: (x tl ,...,x tk ) £ H c } , 
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so the first two requirements are verified. 

To show closure under unions, let A be as above and let B be 


B = {x : (x Sl ,.. .,x Sj ) G 1} 

for some j > 1, s\,...,Sj G T and / C W. We can rewrite A and B by just combining 
their index sets. This is conceptually pretty clear, but notationally it is not extremely fun. 
Enumerate 

{t 1 ,...,t k }U{s ll ...,s j } = {r 1? ...,n} 

and defining two functions <f : { 1 ,..., k} — » { 1 ,..., /} and if : { 1 ,..., j} — > { 1 ,.. by 


<f>(i) = m iff ti = r m 
if if) = m iff Si = r m . 


Then we set 


Now 


so that 


H' C R l = {(j/i, : (W( i)> • • ■ > Vm) G H } 

I' c M 1 = {(j/i, ...,yi) ■ (y^( i),• • • ,yw)) g 1} . 

A = {x \ (; x rii .. ; j x n ) G H'} and B = {x : (x ri ,... ,x ri ) G I'} , 
AU B = {x : (. x ri ,..., x n ) G H' U I'} 


and A U B G E 0 


Now we can equivalently define the product sigma-algebra E by 


□ 


E = cr (E 0 ) . 

The advantage here is that it is now generated by an algebra, and we can use Caratheodory. 


11.2 Kolmogorov consistency theorem 

Theorem 11.5. 7/M is a consistent family of finite dimensional distributions, indexed by 
k-tuples in T, then there exists a probability measure P on M T such that 

= P(z : (x tl , • • -,x tk ) G •) for all (M u ...,t k e M . 

Proof. The strategy is to define P on E 0 and then extend to E uniquely using Caratheodory. 
So if A is a cylinder of the form 

A = {x : (x tl ,..., x tk ) G H} for H Ct fc Borel , 


define 

= ^ . ,jm. 
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Step 1. We will first show that P is well-defined. So suppose that A has two different 
representations: the one above and also 

A = {x : (x Sl , ... , x Sj ) El} for I C R j Borcl . 

Then, as in the proof that So is an algebra, we can find l and H' , I' C M. 1 Borel such that 

A = {x : (x ri ,. ■ -,x ri ) e H'} = {x : (x ri ,.. . ,x n ) e I'} . 

Because we have moved from H to H' and / to I' by possibly adding coordinates and 
permuting them, we use the consistency conditions for 

/hi ) (21) 


and 

(-0 — ( I ) • (22) 

We claim that in fact H' — I'. Indeed, if (yi, ... ,yi) e H' cl 1 then we can hnd a function 
x e M T such that x(r'j) = for i — 1,..., l (just set x equal to these values at the r^s and, 
say, zero everywhere else). Then x e A. But since A also equals {x : x ri , ... ,x ri el'}, we 
must have (yi, ■ ■ ■ ,yi) = (x ri ,... ,x n ) e I'. Thus H' C I'. Similarly I' C H' and we have 
proved the claim. 

Combine the fact that H' = I' with (21) and (22) to obtain 

— ACi ,...,sj(i) 7 


that is, P(A) is well-defined. 
We will continue next time. 


□ 


Lecture 21 


Last time we were proving: 

Theorem 11.6. If M is a consistent family of finite dimensional distributions, indexed by 
k-tuples in T, then there exists a probability measure P on M T such that 

th 1 ,...,t k (-) = f (T : ( x tn ■ ■ ■, x t k ) e •) for all E M . 

Proof. If A is a cylinder of the form 

A = {x : (x tl ,..., x tk ) E H} for H C R k Borel , 

dehne 

nA)=n h . ,JH) . 

In step one, we showed that this is well-defined. 
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Step 2. P is a finitely additive measure on E 0 . First for any t G T, P(f2) = /q(M) = 1. Next 
if A G So is of the form {a: : (x tl ,..., x tk ) G H} for H C M fc Borel, then 

p(^) = >h, . tt m = i - . tt (H) = i - p(x). 

Last if A, B are disjoint elements of So then, as above, we can choose their index sets to be 
the same and write them as A = {x : (x tl , ..., x tk ) G H} and B = {x : (x tl ,... ,x tk ) G 1} 

for H, I C Borel. Since A and B are disjoint, so must be H and /, so 

P(A U B) = ft,. U (H U /) = ft,. tk (H) + ft,..,„(/) = P(A) + P(B) . 

Step 3. P is countably additive on So- For this we must show that if A\ D A 2 D • • • G Eo 

have fl n A n G E 0 then P(fl n Ll n ) = lim„P(A n ). It suffices to consider the case that fl n A n = 0 
and show that P(A n ) —> 0. 

Since (A n ) is nested decreasing, the fact that P is finitely additive on E 0 implies that 
P(t 4„) is non-increasing in n so, by way of contradiction, assume that for some e > 0, 
P(^4n) > e for all n. Each A n is of the form {x : (x tl ,..., x tk ) G H n } for some Borel set 
H n C M fc ". In the specification of A n , we may always expand the index set {t±,... ,tk n } by 
appending extra coordinates (and adding copies of M accordingly), so we may assume that 
the index sets are nested. Furthermore, by possibly repeating each A n some number of times 
and adding hi some number of times to the beginning of the sequence we may assume that 
k n = n. Therefore we can find a sequence of indices • • • and a sequence of Borel sets 
H n C M n such that 

A n = {x : (x tl ,.. .,x tn ) G H n } . 

We will aim to get a contradiction by showing that C\ n A n ^ 0. For this we will need 
to replace (A n ) by nested compact sets. But we need the following lemma, which is pretty 
standard in a real analysis course. We omit the proof, but you can find it in Billingsley, 
Theorem 12.3. 

Lemma 11.7. (Regularity) Let n be a probability measure on M n . If A cl" is a Borel set, 
then given e > 0, there exists K C A that is compact and p(A \ K) < e. 

Using regularity, let K n C H n be compact and such that 

Ht 1 ,...,t n (H n \K n ) < e/2 n+1 . 

Putting B n = {x : (x tl ,... ,x tn ) G K n }, then by definition of 

P(A n \ B n ) < e/2 n+1 . 

We want the B n 's to be nested, so define C n — Bi fl • • • fl B n . Now 

C'n C B n c A n 


and because the AR s are nested, 

n n n 

F(A n \ C n ) < Y, P(^4n \ B h ) < Y \B k )<Y e/2 n+1 < e/2 . 

k =1 k= 1 k =1 
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This means that for all n, 


e < P(40 < P (A n \ C n ) + P (C n ) < e/2 + P(C n ) , 


giving 

P(C n ) > e/2 for all n . 

We can now complete the proof. We have gotten ourselves into a situation where the C' n ’s 
are compact and nested decreasing with P(C n ) > e/2 for all n. This suggests the intersection 
should be nonempty. If we can show this, we will be done since C n C A n and D n A n = 0. 

Since C n has positive measure, it is nonempty. So we can pick x^ G C n . Looking at the 
k-th coordinate (for k > 1) and varying n, gives us the sequence 

. (23) 

For n > k, x^ G C n C Bj., so for such n, (x\™\ ... ,x\^) G Kk, which is a compact set. 
This means the sequence (23) is bounded and has a convergence subsequence. In fact, by a 
diagonal argument, we can find a sequence ni,n 2 ,... of integers such that 

lim xi 77 ^ exists for each k > 1 . 

i k 

Calling this limit Xk, then each coordinate of (x£ l \ x[™ l \...) converges as i —* oo to the 
corresponding coordinate of x := (xi,x 2 ,...). 

Said differently, for fixed k, the vector (aq,... ,aq) is the limit (in i) of (x[^ l \ ... ,x\'^), 
a sequence in Kk , a compact set. Therefore (aq,..., Xk) G Kk, meaning x G Bk for each k. 
Thus x G fl kA k and we are done. □ 

12 Brownian motion (Wiener process) 

For quite a while now we will discuss one particular stochastic process. It will be a collection 
of variables (X t ) for t G [0, oo) intended to model random motion described by Billingsley as 
a particle “suspended in a fluid bombarded by molecules in thermal motion.” Our particle 
will start at position 0 at time 0; that is, A"o = 0 almost surely. Then, for a fixed co, the 
map t i—>• X t {u ) will model the trajectory of our particle undergoing random motion. It 
should be a continuous trajectory, but will appear jagged and irregular. It will be nowhere 
differentiable, but statistically it will actually have nice properties. 

We can construct the Wiener process using the Kolmogorov consistency theorem from 
last section. To do this, we will need to specify finite dimensional distributions - for k > 
1, t\,...,tk G [0, oo) we must define the probability measures Ht u ...,t k on First a formal 
definition: 

Definition 12.1. A Wiener process is a stochastic process (X t ) such that 
1. Xq = 0 almost surely, 
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2. for ti < t 2 < ■ ■ ■ < t k , the increments X tl ,X t2 — X tl ,..., X tk — X tk l are independent 
and 


3. for s < t, the increment X t — X s has mean zero Gaussian distribution with variance 
t — s. 


To show existence of a Wiener process, we define our finite dimensional distributions to 
be those of Gaussian vectors. That is, for t\ < f 2 < • • • < t k define the measure (J,t u ...,t k 
to be the distribution of a k dimensional Gaussian vector (Z tl ,... 7 Zt k ) with mean 0 and 
covariances 

Gov Z ti Z tj = mm{ti,tj} . 

For such variables, if 1 <i<j<k, 


^((z ti — Z til )(Z t . — Z tjl )) — ti — ti — ti_ i + ti -1 — 0 

and for 1 < i — j, 

— Z ti _ 1 )(Z tj — Z ti _f)') = ti — U -1 . 

Finally for 1 — i — j, E Z t .Z t . = ti. In other words, the vector (Z tl ,..., Z tk ) has Gaussian 
independent increments with variance t, l — ti -So we can alternatively define this vector by 
letting Yi,... ,Yk independent Gaussian such that Y t has variance t t — ti -1 for i > 1 and t\ 
for i — 1 and define the Z t f s by Z tj — Y\ + ■ ■ ■ + Yj. 


Lecture 22 


Precisely, for L < ••• < t k e [0, oo), is tl ie measure with density (relative to 

Lebesgue measure) 

.* (ri —* t)= n 7mxx exp 

For any permutation a G S k we define fM aW ,...,t a / k) to be the distribution of (Z t<r(1) ,..., Z ta(k) ). 
This defines a family of hnite dimensional distributions M. 

Proposition 12.2. M is consistent. 

Proof. By definition, M satisfies the permutation requirement of consistency. So we must 
show that if ti,..., t k + 1 G [0, oo) then for Hi, ..., H k C M Borel, 

tt tl ,...,t k ( H i x • • • x H k ) = x • • • x H k x R) . 

By permuting the coordinates, it suffices to show that if ti < ■ ■ ■ < t k and i G {1,..., k} 
then for Borel Hi,..., Hi- 1 , H. l+ 1 ,..., H k C M, 

Pt u ...,t k (Hi x • • ■ Hi -1 xlx H i+ i x • • ■ H k ) 

= x • • • x Hi_! x H i+ i x • • • x H k ) . 


(xj - Xj-iy 
2 (U -U- 1 ) 


, t 0 = x Q = 0 
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(24) 

(25) 



So let l'i,..., Y k be independent Gaussians with mean zero and variances ti, t 2 — t r ,..., t k — 
t k - 1 - Then Ht u ...,t k is the distribution of the vector (Si,..., S k ), where S t — Y\ + • • • + Yj. 
Therefore (24) is 

p (Si e Hi ,..., S,_! e Hi. 1, S i+1 eH l+1 ,...,S k e H k ) . 

However Y t + Y i+1 is normally distributed with variance (fj — d_i) + (t i+ \ — ti) = t i+ \ — ti. 
Therefore the vector (Si,..., Sj_i, S i+ 1 ,..., S k ) (of length k — 1) has the same distribution 
as (Ti,..., T fc _ i), where 

T = Wi + • • • + Wi . 

and the WH s are independent Gaussians with mean zero and variances 

1 1, • • • , ti— i ti— 2, tj-il ti—i, ti -)_2 1, • • • , t k t k —\ . 

But the distribution of (T x ,..., T fc _i) is just liti,...,t i - 1 ,t i+1 ,...,t k i an d this gives (25). □ 

12.1 Lack of continuity 

The previous argument, along with Kolmogorov’s theorem, guarantees the existence of a 
stochastic process with the finite dimensional distributions of that of Brownian motion. We 
even have fi 0 = <5o - that is, vY 0 = 0 almost surely - since the distribution of X 0 is that of 
a centered Gaussian with variance zero. However, Kolmogorov’s consistency theorem gives 
us nothing toward continuous sample paths. In other words, it could be that almost every 
path t i —y X t (u) is discontinuous. We will have to work harder to show the existence of a 
process with this property also. 

In fact, one difficulty is that the set {x : x{t ) is continuous on [0, oo)} C l^ 0 ’ 00 ) is not 
even measurable in our product sigma-algebra. This is a consequence of the following result. 

Theorem 12.3. Let T be some index set and let (X t ) teT be a stochastic process. Then 

1 . 

a(X t : t E T) = (J a(X s : s E S) . 

ScT countable 

2. For any S C T, 

a(X s : s E S) = {{a; : (X s (u)) E H} : H E B s ) . 

The point of the first item is that the right side is actually a sigma-algebra, we do 
not have to generate one. Merely taking the union gives us a sigma-algebra. Why is this 
important? If A E cr(X t : t E T) then actually A E cr(X s : s E S) for some countable subset 
ScT and therefore is “determined” by countably many times s. In the case of H = M T 
and X t = Z t (x), this says that B 7 = U sctB s for countable S. 

The second item is an analogue of what we have seen before: if (Ad,..., X k ) is a random 
vector then u( Xi,... , X k ) equals the collection of all sets of the form {(Ad,..., X k ) E H} 
for H C Borel. 
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Proof. We begin with the first item. We may assume T ^ 0. Call the left side E and the right 
S'. If A G S', then A G a(X s : s G S) for some countable S. But this is a sub-sigma-algebra 
of E, so A G a(X t : t G T), giving the containment D. 

For the containment C we first must show that S' is a sigma-algebra. Choosing S = {t} 
for some t G T, D G <r(X t ) C S'. Next if A G S' then A G <r(X s : s G S') for some countable 
S', and since this is a sigma-algebra, H c G cr(X s : s G S) C S'. Last if A^, H 2 ,... G S' then 
we can find index sets Si,S 2 , ■ ■ ■ C T that are countable and such that A n G S n for all n. 
Then taking S = U n S n , 

cr(X s : s G S n ) C cr(X s : s G S) for all n 

and therefore A n G cr(X s : s G S) for all n. This is a sigma-algebra, so U n A n G cr(X n : s G S) 
and since S is countable, this is in S'. 

Now S' is a sigma-algebra relative to which each X t is measurable (just take S = {t} for 
a given t G T). By minimality, then, E C S'. 

For the second item, the right side is a sigma-algebra (this is not hard to check) and 
contains the cylinders, so it contains the left side. To prove the other containment, define 
the function <f> : hi —> by 

= (W(u;)) seS . 

For any cylinder {X Sl G Hi,... , X Sk G Hk}, the pre image is an element of cr(X s : s G S ). 
Therefore <f> is measurable from a(X s : s G S) to B s (since we only have to check the 
measurability condition on a generating set). This implies that for any Borel set H G 13 s , 

{u : (X s M) seS G H} = $~\H) G a(X s : s G S) 

and this is the other containment. □ 

Corollary 12.4. Taking T = [0, oo), the set of continuous functions is not in B T . 

Proof. Suppose that A = {x G M T : x(t ) is continuous} is in 

B t = a(Z t (x) : t £ T) . 


From item 1 of the last theorem, we can find a countable set S C T such that 

A £a(Z s (x) : s G S) C B T . 

From the second part, we can find a Borel set H G B s such that 

A = {x G M r : (x(s)) se5 G Hj . 

Now take any continuous function x and let t 0 ^ S. Define y by 


y(t) 


x{t) if t 7 ^ t 0 

1 + x(t 0 ) if f = t 0 


so that y is not continuous. However x G A and ( y(s)) s£ s 
contradiction. 


(x(s)) aeS G H, so y G A, a 

□ 



Because of this corollary, we will not even be able to talk about the set of continuous 
functions in the Borcl sigma-algebra, so we cannot show that the Wiener process as con¬ 
structed above has P (t i—>■ X t is continuous) = 1 (this string of symbols is meaningless!). We 
would have had this same problem with the Poisson process last semester if we had tried 
to construct it using Kolmogorov’s consistency, since right continuity is not accessible in 
B T . But we got around this by defining it differently, using i.i.d. sequences, and we will get 
around it this time as well. 

Although Kolmogorov’s consistency actually gives us uniqueness on the product sigma- 
algebra, this is not enough. Given a measure P on the product sigma-algebra, we must 
choose a process with this distribution. One option is what is given to us by the theorem: 
the coordinate process {Z t (x) : t e T), but this will not be a good choice. This issue is 
analogous when choosing a random variable with a given distribution - it does not matter 
what the random variable does on a zero-measure set. So we could try to modify the 
coordinate process by changing it on a zero measure set. However there are uncountably 
many f’s and each particular variable X t {u) could be modified on a zero measure set. So 
we have to choose these exceptional sets consistently. As in the case of defining conditional 
distributions, we will solve this by looking at rationals. 

Lecture 23 

12.2 Continuous modification 

The next theorem proves the existence of a (standard) Brownian motion. 

Theorem 12.5. There exists a process (B t ) t £[ o,oo) such that 

1. for k > 1 and 0 < U < t 2 < ■ ■ ■ < tk, {B tx ,..., B tk ) is Gaussian distributed with mean 
zero and Cov (B t .,B t .) = min{L,i,-} and 

2. for all oj, the map 1 1 -> B t (uj ) is continuous with B 0 (lo) = 0. 

Condition 1 says that ( B t ) is a Gaussian process: its finite dimensional distributions are 
Gaussian. 

Proof. Let (X t ) be the process given by Kolmogorov’s consistency theorem; it satisfies the 
first condition. We will modify it so that the new process satisfies the second condition. On 
a probability one set, we will keep the values of (X t ) at dyadic rationals and redefine at other 
points. 

Step 1. Uniform continuity at the dyadic rationals. Let D be the set of nonnegative dyadic 
rationals: 

^ = {^ : n>i, /c>i| 

and 

M n — max sup \X r — X_^\ . 

k=0,...,n2 n r k k +21 2 " 
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Here we have split [0, n + 2 1 ~ n ] into overlapping intervals of size 2/2" and are taking the 
suprema of differences of X t for dyadic t in these intervals. If we show that M n is small, this 
will mean that \X t — X s \ is small when t and s are nearby dyadic rationals. 


Claim 12.6. 


P (M n > l/n ) < oo . 


Proof. To estimate M n , fix a point t = k/ 2" and m > 0. We first estimate differences when 
r G D is in the m + n-th level of dyadics: by the Etamadi maximal inequality and Markov, 


P 


i =1.2 m +i 


max \X t - X t+i/2 m-\-n I > l/n ) < 3 max F(\X t - X t+i/2 m+ n \ > 1/(3n)) 


i=l,...,2 rn + 1 


< max 3 • (3n) 4 E(X t — A 7 " i+ j/ 2 m+n) 4 . 

i=l,...,2 m + 1 

The variable X t — X t+i / 2 m+n is Gaussian with mean 0 and variance ?'/2 m+n , so it has fourth 
• 2 

moment 3 92( ^ +ri) . So the above is bounded by 


9 • (3n 


4 22(m+ i ) 36 .( 3n )4 


22 (in+n) 2 2n 

The events above are increasing in m and converge to give us the bound 

36 • (3n) 4 


P 


max \X t — X r \ > l/n ) < 

reDn[k2- n ,(k+2)2- n ] 


2 2r 


Summing this bound over n gives 


Y^nMn > l/n) < yy n2 n - ^ < oo . 


2 2r 


□ 


Let 

E = {to : {M n > l/n} occurs finitely often} D (A^ 0 = 0} . 

By Borcl-Cantelli and the last claim (and the fact that the distribution of Ao is <5o), P(E) = 1. 
We claim that for oo E E, for any T > 0, r K > A r (c o) is uniformly continuous on the rationals 
in [0, T], To show this, let e > 0 and T > 0. Pick n 0 such that for n > n 0 , oo G {M n < l/n} 
and choose 5 = l/n, where n is such that 

n > max{T, 2/e, no} . 

Letting q, r G D fl [0, T] with | q — r\ < 6, these two numbers must lie in an interval of the 
form [ 2~ n , (k + 2)2 _n ] for some k — 1,..., n2". So by the triangle inequality 

\X q — X r \ <2 sup A. s — X k2 -n\ < 2M n < 2/n < e . 

s£Dn[k2- n ,(k+2)2~ n ] 
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By uniform continuity, we can extend our process to another: define the process (B t ) by 


B t {u) 


lim r _^ ; rGD X r {oj) if t o E E 
0 otherwise 


Then t H> B t (uj) is continuous for all u with B 0 = 0 and agrees with X t (oj) for c o E E and 
teD. 

Step 2. We are left to show that (. B t ) has the correct finite dimensional distributions. Fix 
0 < ti < ■ ■ ■ < tk G [0, oo) and choose sequences of dyadic rationals (r 2 , n ), • • •, {fk,n) 

such that r^ n —$■ ti for all i — 1,..., k. Then since t B t {oj) is continuous for all u, 

(B rin ,..., B rkn ) ->■ (B tl ,..., B tk ) as n ->• oo surely . 

The vector on the left equals (X rin ,... ,X rkn ) and because the times in this vector are 
dyadic, we know its joint distribution - it is Gaussian with density given by 


k 

fn(x 1, ...,X k ) = fj 
i =1 


l 

. exp 

V 2v r (r i>n - n- 1,„) 


(Xj - 

2 (r i>n 



r 0 ,n = x 0 = 0 . 


As n —> oo, this density converges to that of a Gaussian (Gi,..., G k ) with mean zero and 
covariances Gov GiGj = min {tj,tj}. So by dominated convergence, this must be the density 
function of (X tl ,..., X tk ) and we are done. □ 

In fact a similar argument shows: 

Theorem 12.7 (Kolmogorov continuity criterion). Let (A’ t ) te [o j00 ) be a stochastic process 
and suppose that for each T > 0 there are positive constants a,f3,K such that 

E\X t - W|“ < K\t - s| 1+/3 for s, t e [0, T} . 

Then there is a continuous modification of (X t ). In other words, there is a process (X t ) such 
that 


1. u> X t (u>) is continuous for all u and 

2. for each t > 0, P(A t = X t ) = 1. 

For the case of Brownian motion we took a — 4, [3 — 1, K — 3. 


Lecture 24 


13 Properties of Brownian motion 

From now on, when we talk of a Brownian motion, we mean one with the correct finite¬ 
dimensional distributions and also continuous paths. 
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13.1 Basic properties 

If (B t ) is a Brownian motion then X t , X 2 ,..., given by 

X n = B n B n —i 


is an i.i.d. standard Gaussian sequence. We will use this to derive: 
Proposition 13.1. With probability one, 

limsup —^ = oo and lirninf —= — — oo . 

t-»OQ V t t—HX> yff 


Proof. The fact that B n /\fn is a standard gaussian gives 


P 



> M 


P(£i > M) > 0 . 


Therefore 

P (B n > M\fn i.o.) > 0 . 

However the event {B n > My/n i.o} is invariant under finite permutations of the i.i.d. 
variables X\, X 2 ,.... So the Hewitt-Savage 0-1 law (from homework) shows that B n > My/n 
i.o. with probability one. But then 

P(limsupH i /v / t = oo) > P(limsup B n j\fn = oo) = lim P(lim sup B n /y/n > M) = 1 . 

t^t-oo n —>-oo M —>-oo n—>• oo 


The same argument applied to — B n shows that liminf t _ > . 00 .B t /-\/£ = — oo almost surely. □ 
Now we come to two useful transformations. 

1. (Scale invariance) For any c > 0, the process W t — is a Brownian motion. 

Proof. W t has continuous paths and W 0 = 0. Also for 0 < H < • • • < tk, (W tl ,..., W tk ) 
is a Gaussian vector with mean zero and covariances 

Gov (W ti ,W tj ) = (l/c)EB cti B ctj = (l/c)mm{cti,ctj} = min {U,tj} . 

So it has the correct finite-dimensional distributions. □ 


2. For any s > 0, the process (W t )t>a = ( B t+S — B s ) t >o is a Brownian motion. 

Proof. Again this is continuous with Wq = 0. The finite dimensional distributions are 
Gaussian and you can check they have the same covariance. □ 
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3. (Inversion) The process (Wt), given by 


if t > 0 

otherwise 


W t = 


tBi/ t 

0 


is a Brownian motion. 

Proof. W t is continuous for t > 0 and for 0 < ti < ■ ■ ■ < t k , (W tl , ■ ■ ■, W tk ) is Gaussian 
with mean zero and covariance 

Cov (W ti ,W tj ) = t i t J EB 1/t .B 1/t:j = titj min{l/£j, 1/tj} = mm{ti,tj} . 

Also for any t > 0, 


Cov (W t , W 0 ) = EW t W 0 = 0 = min{0, t} . 

So we need only show that W t is continuous at t — 0. To do this, we use the same 
strategy as in the continuity proof for Brownian motion. 

Let n > 1 and m > 1. Then (Wt) has the same finite-dimensional distributions as (Bf) 
and we can estimate using Etemadi 


P 


( max iBA/om+nl > 1 In ) < 3 max E(\B k / 2 m+n\ > l/(3n)) . 
\k=0,...,2 m ' J k=0,...,2 m ' 


The variable B k / 2 m+n is Gaussian with mean zero and variance k/2 m+n so we apply the 
fourth moment again with Markov for the upper bound 

4 3 k 2 (3n) 4 

3 max (3n) 4 ^—— < 9-—-— . 
fc=o,..., 2 m ' ’ 2 2m+2n — 2 2n 


Taking m —>■ oo, 


VP( max \W r \ > 1 In) < oo , 

' r(fD, r<2~ n 


n 

where D is the set of dyadic rationals. By continuity of W t for t > 0, if W t > 2/n for 
some t G [0, 2 _n ] then W r > 1/n for a dyadic rational r G [0, 2 -n ], so 


E p ( 


max 

ie[0,2- n ] 


\W t \ > 2/n) < oo . 


By Borel-Cantelli, max te r 0) 2 -™i \W t \ > 2/n only occurs for finitely many n almost surely, 
so W t is continuous at 0. □ 


4. As a corollary, we see linp^oo — 0. 

Proof, linp^oo = 0 if and only if lim u _> 0 uBi/ u = 0, which holds by continuity at 
zero of Brownian motion. □ 
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5. Also the positive zero set 


Z = {t > 0 : B t = 0} 

has inf Z — 0. This follows from inversion, the above proposition and continuity. 
Indeed, take W t = tBi/ t , so that W t is a Brownian motion. Then almost surely, 

lim sup W t = oo and lim inf W t — — oo . 

£—>■00 t —> oo 

By the intermediate value theorem, we can find a random sequence ti,t 2i ... G [0, oo) 
with tk —> oo such that W tk = 0 for all k. Then Bi/ tk = 0 for all k and inf Z — 0. 

Lecture 25 


13.2 Non-differentiability 

Using the results of last section, almost surely, 

almost surely, B t is not differentiable at t — 0 . 


Proof. Letting W t = tBi/ t as above, the fact that this is a Brownian motion implies that 
almost surely there is a sequence ■ ■ ■ such that L —> oo and W ti —> oo. Then 


Bi/u ~ B o 
1 /U 


W t —>■ oo . 


Therefore limsup ^ 0 Bh h B(> = oo almost surely. Similarly, lim inf /40 Bh /, B(l — — 00 . □ 

A consequence is that for fixed s > 0, B t is almost surely not differentiable at s. This is 
from the fact that ( B t — B s ) t > s is a Brownian motion. We can say even more, treating all 
real s simultaneously. 


Theorem 13.2. There is an event A with P(A) = 1 such that for all u A, the function 
Btfoj) is not differentiable at any t > 0 . 


The difference here is in the order of quantifiers. We can already prove that for any 
s > 0, almost surely B t is not differentiable at s. We want to prove the stronger statement: 
almost surely, B t is not differentiable at any s > 0. 

Proof. We will show that the upper and lower derivatives are nowhere finite. That is, defining 

D + (t ) = lim sup B t+h ——, D~(t) = lim inf ^ t+h —— 

HO h hio h 


and setting E = {co \ D + [t) < 00 , D~{t ) > —00 for some t > 0}, we will show that E is 
contained in a probability zero event. (Note the phrasing here - we are not claiming E has 
probability zero, since we do not know it is measurable.) This will prove that for all u in a 
probability 1 set, B t is nowhere differentiable. 
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Take any u G E. Then for each t, we can find an integer K = K(t,u ) > 0 such that 

-K < D~(t) < D + (t ) < K . 

This means that for some 6 = 5(t,oj, K ) > 0, 

| B t — B s | < K\s — t\ for all s with t < s < t + 5 . 

Because 5 > 0, there is some n 0 such that if n > n 0 , we can find a k — 0,, n2 n such that 

k — 1 k k + 1 k + 2 k + 3 

-< t < — <-<-<-< t + 8 . 

2 n — 2 n 2 n 2 n 2 n 

Then by the triangle inequality, 


O 

I B k±± B k+j + 1 I < K — for j — 0,1,2. 

2 n 2 " 2 U 

So define the event A n (K) as 

n2 n 

A n (K) = |J 11 B^ - Bk+j-i \ < K2~ n for j = 1,2,3} . 

k =o 

We have argued that if c o E E then for some K , c o is in A n (K) for some K and all large n. 
In other words, 

E C I I lim inf A n (K) . 

n 

Ke N 

We will show the event on the right has probability zero. 

In the definition of A n (K), the increments for j = 1,2,3 are independent and each have 
the distribution of a normal variable with mean 0 and variance 2~ n . By scaling, this is the 
same distribution as 2 ~ n / 2 times a standard normal. So 

P(A n (K)) < nT fp(JV(0,1) < k2L)\ . 

The normal density is bounded by one, so we get the upper bound n2 n (8K/2 n / 2 ) 3 = 
n(8K) 3 /2 n / 2 . In other words, 

for each K e N, F(A n (K)) —>■ 0 as n —> oo , 

and this implies lim inf n A n (K) has probability zero. Summing over K G N completes the 
proof. □ 
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13.3 Stopping times revisited 

In this section we analyze stopping times for stochastic processes. This will be the continuous 
analogue of what we have discovered earlier when studying martingales. Throughout, let 
(X t ) t > 0 be a stochastic process. 

Definition 13.3. We say that a collection of sub-sigma algebras (X t )t>o °.f E is a filtration 
if X s C X t whenever s <t. A stochastic process ( X t )t>o is adapted to (Xt) if for all t, X t is 
X t -measurable. 

Here are some general remarks about filtrations. Because t is a continuous variable, 
things are more nuanced than in the discrete case. 

• (Xt) is right-continuous if, for all t > 0, 

K = r, , 


where = n„>i.F m/n . 

• Typically one assumes that (Xt) is not only right-continuous, but that X 0 contains all 
events in 

I^ = o (U^o-Tt) 

which have probability zero. 

• One says that a filtration (fFt) on (12, E,P) is standard if it is right-continuous and all 
probability zero events of Xoo are contained in Xq. This set of probability zero events 
can be quite large: one typically assumes that the underlying space is complete. That 
is, one assumes that for all A e E such that A C B for an event 5eE with P(H) = 0, 
one has A e E. It follows that P(A) = 0. From this point on, we will only work on 
complete spaces (this is not a loss in generality because one can always complete the 
space.) 

As before, we can define stopping times. 

Definition 13.4. Let r : Ft —> [0, oc] and (Xf) be a filtration of (12. 

1. t is called a stopping time relative to (Xt) if {t < t} G T t for all t > 0. 

2. t is called an optional time relative to (Xt) if {r < t} G Xt for allt> 0. 

Proposition 13.5. Every stopping time is an optional time. Furthermore r is an optional 
time relative to (X t ) if and only if it is a stopping time relative to ( Xf). Therefore if (Xt) 
is right-continuous, stopping times and optional times are the same. 

Proof. If r is a stopping time relative to (X t ) then for any t > 0, 

{t < t} = U n >i{r < t - 1/n} G Xt . 
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So r is an optional time relative to (TV). 

Suppose that r is an optional time relative to (TV). Then for t > 0, we can write the set 
{t <t} = fl n >i{r < t + l/n} £ fl n >i J't+i/n = T) + ■ 

Conversely, if r is a stopping time relative to (T) + ) and t > 0, 

{r <t} = U n >i{r <t - l/n} £ Un>iJ*i/ n ■ 

But each of these sigma-algebras is in TV, so (r < t} £ TV. □ 

Lecture 26 

As before, 

Definition 13.6. For a stopping time r, the stopped sigma-algebra is 

TV — {A £ £ : A fl (t < t} £ TV for all t > 0} . 


Examples. 

1. For any constant t, t — t is both a stopping time and an optional time and X T — F t . 

2. As before, if T\ < T 2 then T Tl C TV 2 . 

3. Also as before, any stopping time r is TV-measurable. 

4. If B C R. then the hitting time of B for (X t ) is 

Tb = inf(t > 0 : X t £ B} . 

If (X t ) is continuous for all (ta) and B is closed, then this is a stopping time relative 
to the filtration (TV) given by TV = o-(X s : s <t). 

Proof. We must show that for t > 0, (r < t} £ TV- The process (d t ) given by 

d t = inf{|W — x\ : x £ B} 

is continuous, since (X t ) is. Also it is adapted to (TV). We claim that 

Tb > t if and only if d s > 0 for all s <t . 

Take s < t and assume that d s = 0. Since B is closed, X s £ B and so (r > 0 : X r £ B} 
contains s. This implies that tb < t. Conversely, if tb < t then for each n > 1, the set 
(r > 0 : X r £ B} contains an element r n with r n £ [0, t+l/n]. Take any sub-sequential 
limit r of (r n ). Since X Tn = 0 for each n, continuity of X t gives X r = 0. But then 
r £ [0,t] and this means d s = 0 for some s < t (take s — r). 

Since d t is continuous, d s > 0 for all s < t if and only if there is some n > 1 such that 
d s > l/n for all s < t. Again By continuity, 

{d s > 0 for all s < t) = u n {d s > l/n} , 

n>l sGQ 

and this is in TV- Therefore (r < t} = (r > t} c is in T t . □ 
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5. If (X t ) is right-continuous for all to and B is open, then Tb is an optional time relative 
to (If). Yon will prove this on homework. 

13.4 Strong Markov property 

Let’s return to ( B t ) as a Brownian motion. The filtration associated to ( B t ) is (It), where 

I t = a (B s : s < t) 

We actually want to have a right-continuous filtration so we will also consider the filtration 
(Jy + ), where as before 

11 n n >,I t-|-l/n • 

Proposition 13.7. For every s > 0, the process W t , given by 

(Wt) t > o = ( B t+S — B s ) t > o 

is a Brownian motion independent of If~. In other words, a(W t : t > 0) is independent of 

I + 

Proof. We have seen that (Wf) is a Brownian motion. First let us show that it is independent 
of I s . Let k > 1 and 0 < ti < ■ ■ ■ < tj.. The set of events that are independent of 
W = (IL't,,..., W tk ) forms a A-system, so we must check that it is independent of a 7r-system 
that generates I s . We will use the cylinders for (B r : r < s). So let H C be Borcl and 
0 < ry < • • • < n < s with / Cl 1 Borel. Then 

P ((w tl ,...,W tk )eH, (B ri ,...,B ri )el) 

= P..., W tk ) e H, {B. n , B r2 — B ri ,..., B n — B n i ) G I') , 

where I' = {(ay,... ,xi) : (xi,X\+X 2 , ■ ■ ■ + - ■ •-) -xf) G /}. By independence of increments, 

this equals 


P((W tl ,. ■ • , W tk ) G H)¥((B ri , B r2 -B ri ,..., B n - G /') , 

which is P((W tl ,..., W tk ) G H)F((B ri ,..., B n ) G I). This shows {(W tl ,..., W t J G H} is 
independent of I s . The set of events independent of I s is a A-system and we have checked 
independence for a 7T-system generating a{W t : t > 0). 

Now that (W t ) is independent of I s , we show it is actually independent of If~. Let 
N > 0. The vector ( B tl+S+1/N - B s+1/N ,... ,B tk+s+l/N - B s+1/N ) is independent of I s+l/N 
and therefore of I s +i/ n for n > N. Thus this vector is independent of If~. However by 
continuity of Brownian motion, 


(Btt+s+i/N — B s+ i/jv, • • •, B tk+s+ i/N — B s+ i/jv) —> iWtii ■ ■ ■ t W tk ) for all u . 


Therefore we can finish by the following lemma. 



Lemma 13.8. If (X N ) is a sequence of random vectors in R k that are independent of a 
sigma-algebra IF and Xx —>■ X point wise then X is independent of IF. 

Proof. Let A e IF and H C be Borel. If P(H) = 0 then 

P (A, x N eH) = o = P(A)P(Xjv e H) . 

Otherwise define the measure Pa(-) = P(- | A). We want to show that the distribution of 
X under Pa is the same as the distribution of X under P. This will show independence. 
So let 4>a,x be the characteristic function of X under Pa and <fx the characteristic function 
of X under P. Because Wv —> X point wise, the dominated convergence theorem gives 
both (px N ~> <f>x point wise and 4>a,x n — » 4>a,x point wise. However by independence, 
<Pa.x n = 4>x n for all N and so fx = 4>a,x- □ 

□ 


Lecture 27 

Much of the material for the next few lectures is taken from Brownian motion by Peres 
and Morters. 

Corollary 13.9. (B t ) is a continuous time martingale relative to (Jy + ). That is 

1. E|5 t | < oo for all t > 0, 

2. B t is 7y + measurable for all t > 0 and 

3. if s <t then E [B t \ Jy + ] = B s almost surely. 

Proof. We need only check the last condition. Write 

E [B t | Fs] = E[H S | Ft] + E [B t - B s \ Ft] 

— B s + E [B t — B s \ . 

However B t — B s is independent of Ft, so this is B s . □ 

We will from now consider the filtration (Ft)- Since it is right-continuous, its stopping 
times and optional times are the same. 

Theorem 13.10 (Strong Markov property). Let t be an almost surely finite stopping time 
and define 

W t = B r+t - B T for t > 0 . 

Then (W t ) t >o is a Brownian motion independent of Ft- 

In the statement we are using the stopped sigma-algebra relative to (Ft)- It is 
Ft = {A e E : A n {r < t} e Ft for all t > 0} . 
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Proof. First approximate r from above for a fixed n > 1 by 


T n 


k + 1 k k + l\ 

- iff r G —,- 

2 n [2 n 2 n J 


k = 0,1,... . 


Note that r n is almost surely finite and it is a stopping time since for t of the form (&; + l)/2 n , 

{r n <t} = {r < (k + 1)2 "} G E^ k+1 ^ n = ■ 

The times r n decrease to r and we will first show the statement for the times r n . 

So set 


B^ "' 1 = B t+k / 2 n — B k / 2 n for t > 0 and hxed k > 0 

and 

W t (n) = B t+Tn - B t for t > 0 . 

For each event of the type {W^ G A } for A C Rt 0 ’ 00 ) Borcl and E G J- + , 


P(fF (n) G A, E) = Y^ P( B k G A, E, r n = k/T) . 

k =0 

The event E D {r n = k/2 n } is in J r fc l ) 2n and by independence of B k (which is just a Brownian 
motion) from this sigma-algebra, we obtain 

OO OO 

P( B k G A)¥(E, T n = k/2 n ) = P (B G A) ^ P (E, r n = k/2 n ) = P (B G A)P(E) . 

k =0 k =0 

Taking E — PL we see that kF^ is a Brownian motion. Because this holds for all E and A, 
it also shows that it is independent of Jy + . 

For the full statement, take k > 1, 0 < t\ < ■ ■ ■ < t k and E G J-p. Since r < r n for all 
n, Tff C Tff n (you will show this on homework), so E G JyP Therefore using the hrst case, 

(Wt™\ • • •, kh/"^) is independent of E. Since r n fr and B t is continuous, 

(Ipy .... <”>) (W,...... W tk ) for all « . 

By the lemma last time, (W tl ,..., W tk ) is also independent of E , so this proves the in¬ 
dependence assertion. Furthermore, since point wise convergence implies convergence in 
distribution, ( Wt ) is also a Brownian motion. □ 

13.5 Applications of the strong Markov property 

The Zero set. 

For our first application we consider the zero set of Brownian motion: 

Z = {t > 0 : B t = 0} . 
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Theorem 13.11. The set Z = Z(u>) almost surely has the following properties. 

1. Z is uncountable. 

2. Z is nowhere dense. 

3. Z is perfect (closed and every point is a limit point of it). 

4- Z is unbounded and has Lebesgue measure zero. 

Proof. Because B t is continuous, Z = Bf 1 { 0} is closed. Also since sup f B t — oo and inf t B t = 
—oo, continuity also gives Z unbounded almost surely. To show that Z is nowhere dense we 
must show that almost surely, Z is not dense in any interval. So assume that Z is dense in a 
non-empty interval I. Then the closure of Z (which is Z, since it is closed) contains I. But 
then B t must be differentiable on this interval, a contradiction. Thus if Z is not nowhere 
dense, B t must be differentiable on an interval, and this is a probability zero event. 

Once we show Z is perfect, it must be uncountable (this is an exercise in Rudin, Ch. 2). 
So we are left to show this and that Z has Lebesgue measure zero. For the latter we need a 
lemma. 

Lemma 13.12. (B t ) is jointly measurable. That is, the map (t,u>) i-» B t (ui) from [0, oo) x 
O —> M is measurable relative to the product sigma-algebra B x £ (where B is the Borel 
sigma-algebra on [0, oo )). 

□ 


Lecture 28 

We were proving properties of the zero set of Brownian motion: 

£ = {t > 0 : B t = 0} . 

Theorem 13.13. The set Z = Z(lo ) almost surely has the following properties. 

1. Z is uncountable. 

2. Z is nowhere dense. 

3. Z is perfect (closed and every point is a limit point of it). 

4- Z is unbounded and has Lebesgue measure zero. 

Proof. We finished last time stating the lemma: 

Lemma 13.14. ( B t ) is jointly measurable. That is, the map (t,co) i-» B t (uj) from [0, oo) x 
0 —> M is measurable relative to the product sigma-algebra B x £ (where B is the Borel 
sigma-algebra on [0, oo) ). 
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Proof. We will exhibit B t is a limit of jointly measurable processes. For each n, define 


B, <n V) = B k/2 „(u) iff b < t < 


Then for fixed (t,cu), continuity of B t gives B\ n \uj) —> Bflco), so we must show that B[ n \u) 
is jointly measurable for each n. So letting H C M be Borcl, note that 


{(t,u):B t (u)eH} = 1J 


k£Z 


k k + 1 
2 n 5 2 n 


x {tu : Sfe/ 2 «(w) 6 


The right side is in S x E so we are done. □ 

By the lemma, for any T > 0, we can apply Fubini to the set : Bfloj) = 0}; letting 

A be Lebesgue measure on [0, T\, 

E [\(Z(lo))\ = (A x P) {(t, u>) : B t foj) = 0, £ € [0, T]} = / F(B t = 0) d\{t) 

Jo 

equals zero. Therefore A (Z) = 0 almost surely. 

Last we show that each point of Z is a limit point of Z. So let z E Z. We already know 
that if z = 0 then z is almost surely a limit point of Z, so assume that z > 0. If there is a 
sequence of zeroes of B t converging up to z then we are done, so we may assume that for 
some rational r < z, z is the first zero of B t after r. In other words, 


z = inf {t > r : B t — 0} . 

Now for each rational r > 0, the time r r = inf {t > r : B t — 0} is a stopping time (the proof is 
a slight modification of the one that says that hitting times of closed sets are stopping times 
for continuous processes). So since r r is almost surely finite, the strong Markov property 
says that ( Bf'' 1 ) = ( B t+Tr — B t ) is a Brownian motion. Since 0 is almost surely a limit point 
of the zero set, we may find an event E r of probability one such that for u G E r , there is a 
sequence rq > > ■ ■ ■ > r r such that each r t e Z(u). 

Now set E = n reQ:r> oE r , so that E has probability one. We claim that for oj e E, Z{oj) 
has no isolated points. If z G Z(u) is isolated then z > 0 since To = 0. We can then choose 
a rational r > 0 such that there is no zero of B t between r and z. It follows that r r = z and 
since u G E r , z is not isolated (from above), giving a contradiction. □ 

Reflection principle and the distribution of the maximum. 

For the next application of strong Markov, we find the distribution of the maximum of 
B t on an interval. We will use the reflection principle: if r is an almost surely finite stopping 
time, we define a new process (B^) which is B t for t < t and for t > t, it is B t reflected 
about the value B T : 

B * = I B t if t < t 

4 1 B T -{B t -B T ) if t>T ’ 
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We will show soon that this is a Brownian motion. Bnt first we use it to compute the 
distribution of 

M t := max B s . 

o <s<t 

Let a > 0 and r a be the (almost surely finite) hitting time of {a}. Then for t > 0, 

P (M t > a) = P(r a < t) 

= P (r a <t, B t > a) + P(r a < t, B t < a) 

= P (B t > a) + P(r a < t, B\ > a) . 

In the last line we have used that if B t > a then r a < t. Also we have used B{ as the 
reflected Brownian motion dehned above, associated to the stopping time r a . If we define r* 
as the hitting time of {a} by B*, then note that whenever B* > a, we must have r a = r*, so 

P( r a < t, B* t > a) = P(t* < t, B* > a) = P {B* > a) , 

and this equals P (B t > a) = P (B t > a). Therefore 

2 f°° x 2 

P (M t > a) — 2P (B t > a) — ~ / e~^ dx . 

v 27 it Ja 

Theorem 13.15 (Reflection principle). If r is an almost surely finite stopping time then 
the reflected process (B*) is a Brownian motion. 

Proof. Reflection is a continuous operation, so the paths of Bl are still continuous. So 
we must only check the finite-dimensional distributions. Billingsley only checks the two- 
point distributions “for notational convenience.” So to do this, first define the approximate 
stopping time r n by 


r n = k/ 2" if and only if r G [k/ 2”, (k + l)/2 n ) . 

We will show that the two-point distributions of ( B {"'**), the Brownian motion reflected using 
r n , are those of Brownian motion. Since B ( t n} * —y B{ point wise, the two-point distributions 
of ( Bj n ' > *) converge to those of ( Bj n ■*), and since they are those of Brownian motion, so too 
must be those of (B ( t ny ). 

r n takes countably many values (only dyadic rationals), so let to be one of them. Let 
s < t be two times; we want to show that for H cK 2 Borcl, 

P('Ll = to, ( B s ,B t ) G H ) = P(r n = to, ( B*,B G H) . (26) 

Then summing over to we will be done. For s < t < to this is true since then B* = B s and 
B* t = B t . For s < t 0 < t, we consider / C M 2 and J cK Borel and get 

P(r n = to, ( B s , B to ) G I, B t — B to G J) = P(r„, = to, (. B s , B to ) G I, B to — B t G J) 

= P(r n = to, (Bl, B*J G I)V(B* to - B* t G J) 

= P(r n = to, (B* s , B*J G I, B; o - b; G J) . 
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So for K — I x J, 

P (r n = t 0 , (. B s , B t0 , B t - B t0 ) E K) = P(r n = t 0 , {B*, 5* , B* t - B*J E K) . 
By the n-X theorem, this holds for all Borel K c M 3 . So set 


K = {(xi, x 2 , x 3 ) : (xi, x 2 + x 3 ) G hf} , 


and we obtain (26). 

Billingsley says that the case to < s < t is similar. We can consider the joint distribution 
of (B to , B s - B to ,B t - B s ) instead of (B s , B to , B t - B to ). □ 

14 Brownian motion in higher dimensions 

Definition 14.1. Let B^ l \ ..., B^ be independent Brownian motions. Then 

B(t) = (Bl 1 \...,B { t d) ) 

is called a (standard) d-dimensional Brownian motion. 

There are some differences between one-dimensional and higher-dimensional Brownian 
motion, for instance with regard to recurrence. 

Lecture 29 


For x E M d , the process 

{x + B t ) t > o 

is a (ci-dimensional) Brownian motion started at x. For notational convenience, let us place 
the dependence on x in the measure: let be the probability measure for which (B t ) is a 
Brownian motion started at x. 

Theorem 14.2. Brownian motion is point recurrent if and only if d — 1. In other words, 
for x,y E R d , 

P x (B t = y for some t E (0, oo]) = 0 

if and only if d > 2. 

The route to proving this theorem takes us first to another result, ft says that if we view 
two-dimensional Brownian motion as a plane curve (from time 0 to 1) then this curve has 
area zero. 

Theorem 14.3 (Area of planar Brownian motion). Let A be two-dimensional Lebesgue mea¬ 
sure and ( B t ) a two-dimensional Brownian motion. Then 

A {Bt : t E [0,1]} = 0 . 
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Proof. The idea will be to show that almost surely, different increments of Brownian motion 
intersect each other in zero measure sets. This will be proved using a scaling trick. Then 
we will use a general lemma to show that this is impossible unless the increments have zero 
area themselves. 

Let X = \{B t : t G [0,1]}. If X has finite mean, then since \/3B t has the same 
distribution as B 3t , we find 

3 

3EX = EX{V3B t : t G [0,1]} = EX{B t : t G [0, 3]} < ^ EX{B t : t G [i — 1, *]} = 3EX . 

2=1 


From the above, assuming EX < oo, we deduce that 


E 


3 

X{Bf : t, G [0, 3]} — ^ } X{Bt : t G [i — 1, *]} 
2=1 


and since this variable is nonnegative, 


0 , 


3 

X{B t : t G [0, 3]} = X{B t : t G [i — 1, i]} = 0 almost surely . 
2 = 1 


In particular, 

EA {{5 t : t G [0,1]} n {B t : t G [2, 3]}} = 0 . (27) 

To justify this, we need to show that X has finite mean. If X > a then Brownian motion 
has to leave a box of side-length y/a centered at the origin. Therefore at least one of the two 
coordinates of B t must exceed yfa in absolute value for t G [0,1]. Setting = B < ' t l) for 
* = 1 , 2 , 

P(X > a) < P M^l > yfa. for some i — 1, 2^ < 4P > yfa^j . 

By the reflection principle, we obtain 

P(X > a) < 8P > yfaj . 


Therefore 


EX = 


P(X > a) da < 8 


P ( b[ 1] > 


and since is a standard Gaussian, this is finite. 
Now we define two Brownian motions: 



da 


ITi (t) = B t and W 2 (t) = ( B t+2 - B 2 ) + B x for t G [0,1] . 

By independence of increments, both of these are independent of Y := B 2 — B 2 (the second 
is a sum of increments B\ and B t+2 — B 2 ). Letting 

R(x) = X {{Wi(t) : t G [0,1]} n x + {W 2 (t) : t G [0,1]}} , 
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we have 
By (27), 


R{Y) = A {{B t :ie[0,l]}n {B t+2 :te[ 0, l]}} . 

0 = Ei?(F) = E [E [R(Y) I Y]] = -L= [ e~ x2/2 ER(x) dx , 

v 27 T J 


So ER(x) = 0 for almost all x G M 2 and therefore R(x) = 0 for almost all x G M 2 , almost 
surely. This means 

A{a; G M 2 : R(x) > 0} = 0 almost surely . (28) 

From (28), we will use a general lemma to finish the proof. The bounded assumption 
below is not necessary, but it is ok for us since the sets A and B are just images of Brownian 
motion. 

Lemma 14.4. If A, B C M 2 are bounded Borel sets with positive area, 


Proof. By Fubini, 


A {a; G M 2 : A{A D (x + B)} > 0} > 0 . 


(1a *1 -b){x) dx = 1a(ui)1-b(x — w) dw dx 


1a{w)1b{w — x) dw dx 




= J 1 a(w) yj 1 b(w — x) dx J dm 
= X(A)X(B) , 

and this is positive. Therefore 

A{x G M 2 : (1a * 1 ~b) (x) > 0} > 0 . 

However 

(1a * 1 -b) (x) = [ l A (w)l_ B (x - w) dw = [ l A (w)l B +x(w) dw = A {A n (x + B)} . 


□ 


By the lemma applied to (28), we see that almost surely, either {Wh(f) : t G [0,1]} or 
{W 2 (t) : t G [0,1]} has Lebesgue measure zero. Note 

\{W 2 {t) : t G [0,1]} = \{B 2+t — B 2 + Bi : t G [0,1]} = \{B 2+t — B t : t G [0,1]} 

and this is independent of 

X{W 1 (t):te[0,l]} = X{B t :te[0,l]} 

with the same distribution. Therefore they must both be zero with probability one and this 
completes the proof. □ 
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Lectures 30 and 31 


From the result on area, we can prove that for d > 2, Brownian motion is not point 
recurrent. 

Proof. First take d — 2. By the previous theorem, for fixed y, 

I P y (x G {B t : t G [0, 1]}) dx = 0 . 

This means that for A-almost every iel 2 , 

0 = P y( x G {Bt '■ t G [0,1]}) = Po(a; — y G {B t : t G [0,1]}) 

= Po(?/ — x E {B t : t G [0,1]}) = P x {y £ {Bt '■ t G [0,1]}) . 

Therefore for n > 1, setting B / = B t+ i/ n — Bi/ n , 

Eo {y G {Bt '■ t G [1 /n, 1]}) = Eo [Po(l/ G {Bt '■ t G [1 /n, 1]} | 5i/ n )] 

= E 0 [P 0 (y £ {Bi/ n + {Bl : t G [0, 1 — 1/n]}) | 

= E 0 Pb v „(j/ e : t G [0,1 - 1/n]}) 

= j P x (y G {B t : f G [0,1 - 1/n]}) dB 1/n (x) = 0 . 

To go from the second to third line we have used the fact that B t and (_B f * : t G [0,1 — 1/n]), 
so conditioning on B t amounts to viewing B t as a deterministic number. We finish with 

Po(y G {B t :tE [0,1]}) = lim P 0 (y G {B t : t G [1/n, 1]}) = 0 . 

n 

if d > 2 then just project Brownian motion onto the first two coordinates. □ 

• Although in d = 2 Brownian motion is not point recurrent, it is neighborhood recurrent: 
for any ball B r of radius r > 0, and all y G M 2 , 

P y (B t G B r for some t > 0) = 1 . 

• For d > 3, Brownian motion is neither point recurrent nor neighborhood recurrent. 
These statements can be proved using the relation to harmonic functions. See Peres- 
Morters, Ch. 3. 

15 Stochastic integration 

One way to build continuous stochastic processes from Brownian motion is to integrate. For 
example, since Brownian paths are continuous, we can always integrate them path by path 
to obtain a new process 

X t = I B s ds . 

Jo 


77 



We can give many variations on this, like integrating functions of Brownian motion: J* f(B s ) ds. 
Both of these examples have B t as the integrand. It is much more difficult to make sense of 
expressions like J 0 * f(s) d B s or f* X s d B s , where X s is another stochastic process. Here we 
are integrating with respect to Brownian motion. 

Why would we want to define such integrals? Well one point of view comes from stochas¬ 
tic differential equations. Suppose X t is a random process which, say, models the erratic 
movement of a particle. Suppose we can write an equation like 

X t = f a(X s ) d B s + [ b(X s ) ds . 

Jo Jo 

This is written in short hand (as an SDE) as 

dX t = a(X s ) d B t + b(X s ) dt . 

We can interpret this infinitesimally by thinking that in a small amount of time, our particle 
gets a push in the direction of b(X s ) (where X s is the current position) - this is the term on 
the right, which is the drift term - but also a random diffusive push by a Brownian motion 
B t with strength a(X s ) - this is the diffusive term. Here we are modeling a system that 
satisfies an ODE that is subject to some random noise. 

The problem here of course is that d B s does not make any sense. We know from the 
theory of Lebesgue-Stieltjes integrals that we can only define f* f(s ) dg(s) when g has 
bounded variation. And we have seen that Brownian motion does not have this property: 
functions of bounded variation are differentiable almost everywhere, and Brownian motion is 
not differentiable anywhere. So to make sense of this integral we will have to take advantage 
of the fact that, since we are dealing with randomness, we can build integrals using various 
types of limits, including almost sure convergence, probability convergence, convergence in 
L p , etc. 

15.1 Integration of step processes 

As usual, we will give a simple definition of the integral when the integrand is itself simple. 
For the remainder, let ( B t ) be a Brownian motion defined on a space (H, E,P) and (Xt) any 
filtration such that 

1. ( B t ) is adapted to (Xt), 

2. the strong Markov property holds for (B t ) on (Xf) and 

3. (r(X t : t > 0) contains all P-probability zero events in E (it is complete). 

Definition 15.1. A simple process is of the form 

k 

St. = S t (u) = ^^aj(u))l(tj,tj + x](t) 5 

3 =i 
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where a 3 is an F t -measurable random variable and 0 < ti < ■ ■ ■ < tk+ 1 - For a simple process 
we define the stochastic integral 


/•OO k 

/ S, dB s = V' aj(B tj+1 - B, 

Jo ,=i 


We should check that the integral of a simple process is well-defined. So suppose that 
(S t ) can be written in two ways: 


St. ^ ] a jl(*7,*7 +1 ] anf l Sf ^ ' bjl( UuUi+ 1] 
3 =1 




We must show that 

k m 

a A B tj+1 - Btj) = b i( B "i +1 “ B ui) • ( 29 ) 

j=i *=i 

Write A = {fi,..., tk+ 1 } and i? = {tp,..., u m+ 1 }. First assume that A C B. If = #A +1 
then there is some interval, say with u j = fi,w 3 = t 2 and «2 £ It follows that 

62 = cl\ and so (29) holds. If JfB > ff A + 1 then we simply iterate this argument: we write 
B \ A = {uk 3 , • • •, Uk a } and apply the previous argument to move from A to A U { u ^} to 
A U {w^, Uk 2 } and so on. 

For general A and B, we let C = A U B = {ri,..., r p+ 1 } and write 

St = ^2S rs l {r3!rs+l] . 

s=l 

Then by the above argument applied to A and C, then to B and C, we obtain 

k p m 

- B h ) - BO = <(«».« - B “.) ■ 

j=l s=l i=l 

Note the following facts. 

• A simple process is adapted. That is, if (S t ) is simple, then S t is Jp-measurable. 

• A simple process is jointly measurable. In fact, it is progressively measurable. That 
is, for each t > 0, the map S : [0, t] x tt —> R given by S(s,u >) = S s (lo) is measurable 
relative to £>([0 ,t]) x -F), where £>([0,f]) is the Borel sigma-algebra of [0, t]. 

• Actually all processes that are adapted to (fF t ) and are either right or left continuous 
are progressively measurable. 


79 



Proof. The proof is very much like the one that Brownian motion is jointly measurable. 
If X f is right-continuous and adapted to (J 7 t), then for 0 < s < t define X^ by 



A 0 

X (fc+iy 


if s = 0 

if M / « < ( fc + 1 )^ 
11 2 n ^ ^ — 2 n 


As before we can show that this function is £>([(), t\) x JF t measurable. By right conti¬ 
nuity, xi 71 ' 1 —> X s for all s e [0,f] and well, so the limit is B([0,t}) x Ar measurable. 
The proof for left continuity is similar. □ 


• If (A" f ) is progressively measurable then for each t, the t (->• E(Ah) + and t E(A/)_ 
are Lebesgue measurable on all intervals. Therefore by Fubini, 

pb pb pb 

E / /(Ah) d t= E/(Ah) d t if / E\f(X t )\ dt<oo. 

J a J a J a 


Let us give some important properties of this simple definition. We will restrict to simple 
processes that have square integrable jumps. That is, we define 

POO 

\\H\\\ = / E H? d t . 

Jo 

Theorem 15.2. Let S t ,T t be simple processes such that ||Sj| 2 , ||T|| 2 < oo. 

1. For a,b e M, 

poo poo poo 

/ (aSt + bT t ) dB t = a S t dB t + b T t dB t . 

Jo Jo Jo 

2. The mean E S t dB t is zero. 

3. (Isometry) 


E 


'o 


S t dB t I = E / S( dB t ■ 


'0 


Proof. If St and T t are simple processes defined over the same intervals: 

k k 

S t = X] a i 1 (bA+i]W and T t = ^2 b AKt j ,t 1+1 ](t) 

3 =1 3 =1 

then .tt T, - Yj=\( a ) + (0 and 


(S, + T.) AB t = +b j )(B, I+1 - B tj ) 

3 = 1 


St dBt + / T t dBt . 
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If S t and T t are not defined over the same intervals, we can force this. Namely, if S t = 
Y^ k j=i a j 1 (t j ,t j+1 ] and T t = Y'" , then we can write A = {t 1: ..., t k +i}, B = 

{si,..., s m +i} and C = A U B = {ri, ..., r p+ i}. Then we can write our simple processes as 


S t = SriMrurt+i] and T t = Yl 7 '' 1 


(n,n+ 1 ] 


1=1 


i= 1 


and this puts us back in the previous situation, proving additivity. 
Also if S t = Yj k ;=i r/ ./l : ’ and a e R then 


pOO n p 

/ aS t d B t = V] aaj(B t . +1 - B t .) = a 
Jo j=1 ' Jo 


= a I S t d B t . 


This shows part 1. 

For part 2, note that B tj+1 — B tj is independent of JFj and therefore of a 3 , so 

/•OO ^ 

E / S t d B t = V EajE(B tj+1 - B tj ) = 0 . 

Jo ,=i 

Last if y.j = aj(B t . +1 — B t .) , then by independence, E y 2 - = Ea 2 E (B tj+1 — B t .) , which is 
Ea 2 j{tj + \—tj). Therefore 


k k „ c 

5Z = Ea ?(^+i -tj)= / 

3 =1 3 =1 


EA 2 dt . 


Now if i < j then 


Therefore 


E ViVj = E[E [yflj | T tj \] = E[j/ i a i E[Sf i+1 - B t . \ Yfi] = 0 

' poo \ ^ /»c 

/ At d/it ) = ^ Et/jj/j = / 

Jo / ,, 7=1 io 


E 


EA 2 dt . 


□ 


Lecture 32 


15.2 Approximation of progressively measurable integrands 

We can use the isometry to define integrals for more processes. 

Definition 15.3. Define V as the collection of progressively measurable processes X t with 
\\Xh < oo such that there exists a sequence (A* ) of simple processes with ||A^|| 2 < oo for 
all n and 

||Ad)-X|| 2 ->0 . (30) 

Write A4 for the collection of progressively measurable processes (X t ) with ||A|| 2 < oo. 
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You will show on the homework that V = A4. The idea is first to approximate by a 
bounded progressively measurable process, then a continuous one, and then a simple one. 

Lemma 15.4. 

V = M . 

To show existence of the integral, we will continuously extend the definition from simple 
processes to the class M.. This is analogous to the following situation. Suppose that X and 
Y are metric spaces and T : X —> Y is an isometry defined on a dense subset X of X. Then 
one can extend T to all of A" simply by defining T(x) = lim„ T(x n ) for any sequence ( x n ) in 
X such that x n —* x. By the isometry property of T, this definition does not depend on the 
sequence ( x n ) chosen. 

To realize the above strategy, we would like T to be the map from A4 to L 2 that sends 
a process to its integral. We do not need to fully show that Ad is a metric space; we only 
need the following fact: if X, Y E A4 then the triangle inequality holds: 


11 ^ + 112 = 


E(X t + Y t ) 2 d t < 


EX 2 d t + 


EY i 2 dt=||X|| 2 + ||Y|| 2 


To see why the middle inequality holds, just note that it is the triangle inequality using the 
L 2 -norm on a bigger space: x [0, oo) with measure P x A, where A is Lebesgue measure on 
[0, oo). 

Theorem 15.5 (Existence of the integral). Let (X t ) E A4. The limit 



X t dB t 


lim / S^ dB t exists 

n Jo 


in L 2 (Q) for any sequence (St) of simple processes as in (30) and is independent of the 
sequence. Furthermore, 


E 


f* oo \ 2 

Y t dB t 1 = 


'o 


ex; dt 


(31) 


Proof. If ("■*) and (T^) are sequences of simple processes as in (30), then for any m, n > 1, 
(St™^ — St '' 1 ) is simple, so by isometry, 



d B t - 



d B t 


2 


||Y (n) - Y (m) || 2 < || Y (n) - X\\ 2 + ||Y (m) - X\\ 2 -)• 0 . 


Note that on the left side, we are using the L 2 norm on the space L 2 (Sl , P), since the integrals 
are just random variables. This shows the sequence J 0 °° S^ d B t is Cauchy in L 2 and, by 
completeness, it has a limit. Also 



d B t - 



rjl(n) 

1 t 


dBt 


= ||^ (n) -T( n )|| 2 < \\s^ -X\\ 2 + \\T^ - X\\ 2 -E 0 , 


2 
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so this limit does not depend on the sequence of simple processes used. 
To show isometry, note by definition of the integral, 


r»oo 


sl n) d B t - I X t d B t 
I o Jo 

By the triangle inequality and isometry, 


-»• 0 


|| >S ,(n) || 2 


Xt dll 


Sj n) d B t 


< 


'0 

poo 


(S 


(n) 


Xt) d Bt 


X t dll 


-G 0 . 


Thus ||||2 —» fn° X t d B t . However by the triangle inequality proved before this theo¬ 


rem, 


IIS' 


n)\ 


l|A'|| 2 < ||S<"> - Xh -» 0 , 


□ 


so also ||S' (n) || 2 —> ||X|| 2 . This shows (31). 

15.3 Integral as a process 

For T > 0, let JH T be the set of progressively measurable (X t ) t >o such that 

[ EX' 2 ds < oo . 


For such (X t ), we can define the integral of X t over t G [0, T] as a process. This is analogous 
to defining an indefinite integral. 

Definition 15.6. The indefinite integral of (X t ) e A It is defined to be the process (lt) fe [ 0i T] 
given by 

ft fOO 

Yt = X s dB s := / X s l[o ) t](s) dB s . 

Jo Jo 

Note that for each t G [0, T], the process (X s l[ 0jt ](s)) G Xi t since it is a product of two 
progressively measurable processes (l[ 0ii ](s) is because it is deterministic) and by assumption 

noo pt fT 

/ E (Xl [0 ,t](s)) 2 ds = / EX s 2 ds< / EX 2 ds<oo. 

Jo ' Jo Jo 

So the integral is defined for all t G [0, T\. 

Just as in the case of constructing Brownian motion, we must modify (Yt) to get a version 
with continuous paths. 

Theorem 15.7. For (X t ) G A It and T > 0, the process (F*)te[ o,t] given by Y t = f* X s dB s 
is adapted to (JF t ) and has a continuous modification. That is, there is a process (Jt)te[o,T] 
with continuous paths such that 

\ = Y t ) = 1 for all t > 0 . 


Furthermore, (J t ) is a martingale. 
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Lecture 33 


Now we will prove the theorem 

Theorem 15.8. For (X t ) £ Air and T > 0, the process (Y t ) t£ [ 0tT ] given by Y t = J* X s dB s 
is adapted to (At) and has a continuous modification. That is, there is a process (Jt)te[o,T] 
with continuous paths such that 


P (J t — Yt) — 1 for all t > 0 . 


Furthermore, (J t ) is a martingale. 

Proof. To begin with, let us show ( Y t ) is adapted to A t . To see this, let (Ss ^)s> 0 be a 
sequence of simple processes such that ||A"1[ 0 ^ — —* 0. Although S^ is defined using 

intervals [tj,tj+ 1 ) for 0 = to < t\ < ■ ■ ■ < tk+ 1 , we can “chop” it at time t, defining a new 
step process by = S^lrom Then by isometry, 



< ||A (n) -X\\\ -£ 0 


However the term on the left is E ^d B s — Y^j , so 

T s (n) d B s -> Y t in L 2 . 

Since d B s is A t measurable, so is Y t . 

Next we move toward the continuous modification. We will first approximate by simple 
processes and show their integrals are martingales with continuous paths. Then we will 
apply Doob’s maximal inequality to exhibit (Y t ) as a uniform limit of continuous functions. 
So pick a sequence of simple processes (S ( t n> ) £ M. such that || — A"1[ 0T ]|| 2 —> 0: 

E (S t (n) - X t ) 2 dt^O . 

Now define 

4 n) = [ Si n) d B s for t £ [0,T] . 

Jo 

We claim that for each n, ( l[ n ' > ) is a martingale relative to (At). To prove this note first that 
(I ( t n) ) is adapted to (At), and write 

S t l) = ^ J a 3 1 A,t j+1 ](t) 

3 =1 
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and let s, t satisfy 0 < s < t < T. If s G (t p , t p+ 1 ] and t G ( t q , t q+ \] for p < q, then 

POO POO 

I M_ I («) = S pi m (u)dBv- Sl”>l [M («)d B u 
Jo Jo 

POO 

= / SI-'ImM d B a 
Jo 

= a p(B t p+1 _ Bs) + a p+i(B tp+2 - B tp+ 1 ) H-h ci q (B t - B tq ) . 

For the first term, 

E [a p (B tp+1 - B s ) | X s \ = a p E(B tp+1 - B s ) = 0 . 

All subsequent terms are of the form A(B U2 — B U1 ) for s < U\ < w 2 and A a random variable 
which is X U] -measurable. So using the tower property, 

^[A(B U2 - B U1 ) | X s ] = E [E [A(B U2 - B U1 ) j X U1 ] \ X s ] 

= E [AE[B U2 - B U1 ]] = 0 . 

Therefore 

E [ r S™ d B u I X s ] = f S™ dB u + E f" f S™ d B u - f S™ d B u \ X s . 

Jo J Jo IJo Jo 

and this is J Q S sA d B u , proving the martingale property. 

Furthermore, t (->• f* Ss ”' ) d B s is continuous by the representation above for f* cl B u — 

A B A d B u . So we will analyze it using the continuous time version of the Doob maximal 
inequality. 

Lemma 15.9. Let (Y t ) te [ 0yT \ be a martingale relative to (Jy) such that t\-*Y t is continuous. 
Then for each a > 0, t e [0, T ], 

P ( max |Yg| > a ) < —EF '. 2 . 

\o<s<t J a 2 

Proof. Define for each n the sequence (x{f l> . J 7 /,"' 1 ),..., (Aj?, Aff}) by 

Xl n) = Ym and A n) = Xm * 

Then for each n, this sequence is a martingale. So by the maximal inequality for martingale 
sequences, 

P ( max \xl n) \ > = ^EY 2 . 

\k= o,..., 2 » k ~ J ~ a 2 a 2 

As n increases, the events on the left are nested. So if we take n —> 00 , we obtain for 
D t = {kt/2 n : n > 1, k = 0,..., 2 n } 

P [ sup \Y q \ > a ) < -—-jEY 2 . 
ygeD t n[o,t] J a 

Since Y t is continuous, the left side equals P (max 0 < s < t |Y S | > a) so we are done. □ 
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Using Doob’s inequality, for m, n > 1, since (/ # (n) — lj: m ' > )t e .[ o,t\ is a continuous martingale, 
if a > 0, 

P ^ max |/ s (n) - J s (m) | > a^j < ^E(4" } - I^) 2 = ^2 J Q E (^ (n) “ dt ■ 

Because this converges to 0 as n,m —* 00 (by choice of the approximating sequence (S 1 ^)), 
we may choose a subsequence (rq) such that 


P 


max 

0<t<T 


rfafc) 


j{ n k+ 1 ) 
1 t 



< 2 _fc 


and by Borel-Cantelli 


P 


f 


max 

\0<t<T 


r( n fc) 


r( n k+ 1 ) 


> 2- fc i.o. 


0 . 


Therefore for almost every cu, there is a K(oj) such that 


max I/. 

0<t,<T 


(n k + 1 ) 


- /, 


(«fc)| 


< 2“ fe for k > K(uj) . 


This means that the sequence (1^^)^ of functions converges uniformly, and so the limit, 
called (J t ) te [ 0j T] is continuous. 

Next time we will show that ( J t ) is a modification of (Y t ) and that it is a martingale. □ 


Lecture 34 


First we finish proving: 

Theorem 15.10. For (Xf) e Air and T > 0, the process (U)te[o,T] given by Y t = J* X s dB s 
is adapted to (Xt) and has a continuous modification. That is, there is a process (J t )te[o,T] 
with continuous paths such that 

P (J t — Y t ) — 1 for all t > 0 . 

Furthermore, ( J t ) is a martingale. 

Proof. We have shown everything but that 

Jt := lirn 7 t (nfc) 

k 

(where I ( 1 n} is an indefinite integral of a simple process S ^ that approximates X , and rq ; is a 
subsequence chosen so that the convergence above is uniform almost surely) is a modification 
of Y t and that it is a martingale. 



To see that for each t G [0, T], J t — Y t almost surely, we note that for fixed t, 1^ —> Y t 
in L 2 : by isometry, 

||4 n) - y t || 2 = I \(s {n) - x)i m \\ 2 < ||(sw - x)i [0>T] \\ 2 -+ o. 

and so 4”^ —y Y t in L 2 as well. Thus there is a subsequence l{ k] ' > that converges to Y t 
almost surely. However I\ nk ^ converges almost surely to Jt by the above argument, so we 
must have J t = Y t almost surely. 

Last we must verify that (Jt) is a martingale. We already showed that for each n, 
(It^)te[o,T] is a martingale, so for 0 < s < t < T, 

E I^ | J r s = I almost surely . 

Because lj n ^ —)■ J t in L 2 , using Jensen, 

E (e[ 4 h) I X s ] - E [J t I j;,]) 2 < E(/ t (n) - Jt) 2 0 . 

This gives 

E[/ t (n) | J r s ] E[J t | Xs] in L 2 . 

But the left side is 4 re \ which converges in L 2 to J S1 so 

E[J t | Ws] = J s almost surely . 

□ 

16 Ito’s formula 

Because of the last section, if we are given a process X t that is in JY[ T for some T > 0 and, 
say, a continuous function / : M —>• M, we can make sense of 

Y t := [ X s d B s + [ f(B t ) d t . 

Jo Jo 

In this case we would write this in short-hand as 

d Y t = X t dB t + f(B t )dt . 

Now we ask if we can write a similar short-hand for functions of Y t . That is, if / : M —> M 
then what is df(Y t )7 We will start with the case that Y t = B t . So we ask if we can write 

df = XtdBt + Z t dt . 

In integral form, this is 

f(Bt) - /(Bo) = T x. s d B s + f Z s ds . 

Jo Jo 
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To relate to ordinary calculus, if B t = g(t ) were a deterministic differentiable function, 
we could use the chain rule for 

(f°g)' (t) = -g'(t) 

so 

f(g(t)) - f(g( o)) = [ f(g ) dg . 

Jo 

In the case that we use Brownian motion for g, the non-differentiability leads to an extra 
term. 

Theorem 16.1 (Ito’s formula - simplified version). Let f : M —> R. be C 1 such that for some 
T > 0, / 0 T E(/'(hh)) 2 dt < oo. Then with probability one, 

f(B t ) - f(B 0 ) = f f\B s ) dB s + ± f f"(B s ) ds for all t e [0, T] . (32) 

Jo z Jo 

Before we give the proof, let’s give some examples and discussion. This version of Ito’s 
formula can be written in differential form as 

d/ = f'dB + l -f"dt . 

You can remember the proof as follows. We do a Taylor expansion for /: 

f(B t+h ) - f(B t ) = f'(B t )(B t+h - B,) + \f"(B t )(B t+h - B t f + ■■■ . 

This is written in differential notation as 

df = fdB+ \f" (dB) 2 + • ■ ■ . 

Now we use the rule (cLB) 2 = dt and (d B) k = 0 for k > 3. This is justified because we know 
that 

k n k n 

^ (BAn) — B (n) ) 2 —> t and V (B l t f > — Bj„) ) m —> 0 for m > 3 . 

k= 1 k =1 

Therefore we obtain 

df = f'dB + l -f"dt . 

Using this heuristic we will “derive” Ito’s formula for functions of Brownian motion and 
time. The actual proof is very similar to the previous one, and we will not use it later, so 
we will just show it for some examples. 

Theorem 16.2 (Ito’s formula). Let f : [0, oo) xl be twice continuously differentiable. Then 

df [df ld 2 f I 

df(t,B t ) = J-(t,B t ) dB t + + dt. 
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Proof. (Sort of). We again Taylor expand: 


d/ -s a ”»:s iaw +'-' 

*i**s«- 

d 2 f 

+ ~4~dBdt+--- . 
axat 

In the first line, the (d-B) 2 becomes df and all higher terms are zero. In the second line, (df) fc 
for k > 2 are zero. And in the last line (mixed partials), all terms have at least one d B and 
one df, giving zero. □ 

Examples. 

1. Take f(x) = x 2 . Then Ito’s formula gives 


B 2 — Bq — 2 / B s d B s + t , 


In particular, we see that B 2 — t is a martingale. Note here that we do not get only 
\B 2 , as we would if we applied the rules of ordinary calculus. 

Lecture 35 


We continue with examples of Ito’s formula. 
1. Take f(x) = x k for k > 2. Then 


B k = k I B k ~ l cl B s + ——^ [ B k ~ 2 ds . 

2 In 


2. Take f(x) = e ax for a > 0. Then 


e aBt - 1 = a e aBa d B s +— / e aB > d t . 


3. (Geometric Brownian motion). Let X t = exp ( crB t + (ji — |o- 2 )t) • Then this is /(t, B t ), 
where 

f(t, x) = exp (ax + (n - . 



Then 


df 

i^ x ‘> = aX ‘ 


<Gf 

dx 2 


(t, x,) = X-x, 


%(t, x t ) = ^-\ a 2 )x t . 

So by Ito’s formula, 

dX t = aX t d B t + jxX t d t . 

The way to interpret this is that at time t, infinitesimally, X t changes by a Brownian 
increment with variance ( aX t ) 2 and has a drift of fiX t . Since X t > 0 for all t, this is a 
nonnegative drift. 

If we take n = 0 then 

dX t = (jXf d B t . 

In other words, 

X t — 1 = X t - X 0 = a [ X s d B s , 

Jo 

and we find that X t is a martingale. 

4. Let X t = e‘/ 2 cos B t . Then X t = where f(t,x ) = e t ^ 2 cosx. So 


df — 


-X t - -X t 
2 2 


dt - e t/2 sin B t d B t = -e t/2 sin B t d B t . 


t 


So 


°}! 2 cos B f — 1 = — e s ! 2 sin B , d B. 


and X t is a martingale. 


Proof of Ito. Recall the statement: almost surely, the following holds for all t G [0, T]\ 

ns,)- /(s 0 ) = r f( B ‘) ^ + \ [ s"( b ‘) ds • < 33 ) 

Let to ^ [0, T\ be rational and let 

A to = {(33) holds for t = t 0 } . 

We will show that P(A to ) = 1 . Assuming this, then A := n toe [o,T]nQ^4i 0 has P(A) = 1 and 
for u> e A, (33) holds for all rational t G [0, T]. But both sides of (33) are continuous in t, 
so on A, it must hold for all real t G [0, T\. 
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The proof of P(A t ) = 1 is similar to that of the fundamental theorem of calculus, but we 
use Taylor’s theorem instead of the intermediate value theorem, since we must keep track of 
remainders of order 2. For this reason, define for 5 > 0 and M > 0 

u(6,M) = sup{|/"(x) - f"{y)\ :x,ye [—M, M\, \x - y\ <5} 

(note that by symmetry the absolute values are not needed above). Let 

Pn = {0 = C < i<”> < ■ ■ ■ < t W = i}, n > 1 

be a deterministic sequence of partitions of [0, t] and, writing ||P n || = max i= i ,...,k n (t^ — 
assume that ||P„|| —> 0. On each subinterval \tf ^, f ■”) ] we apply Taylor’s formula to the 
image under By. for some c between x = B („) and y = B m , 

t i t i+l 

f(y ) - f(x) - f(x)(y -x) = \f"{cfx - yf 

f(y ) - f(x) - f(x)(y -x)- ^f"(x)(x - yf = ^{x - yf |/"(c) - /"(x)| 

< u(S n ,M t )(x - yf , 
where S n = max k=1 kn \B 1 (n) - B 1 (n) | and M t = max 0<s <t \B S \. 

L k L k -1 

Therefore 


iv-n iv-ri 

Co(S n , M t ) V(P t (n) - P t (n) ) 2 > V(/(P t (»)) - /(P t (n) )) 

■ “ L k — 1 ‘ “ L k u k — 1 


z * 6 fc-l L k L k -1 








(34) 

(35) 

(36) 


The term (34) equals f(B t ) — f(B 0 ). Since f' is continuous, f'(B t ) is a progressively measur¬ 
able process and by assumption, it is in A4 t , so (35) converges to J 0 f'(B s ) dP s in probability. 
Also f" is continuous, so a homework problem from this week shows (36) converges in prob¬ 
ability to — | f f"(B s ) d.s. Choosing a subsequence (n k ) such that all of these convergences 
occur almost surely, we find 

f(B,) - /(Bo) - j f(B,) AB, - i / f"(B s ) ds 

n fc -l 

(^n fc ) Af() ^ (B (n k ) ~ B (n k )) 

- J U+l Z i 
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By the quadratic variation calculation on the homework, 

Tlk~ i 

) (B (n fc ) — B (u k )) 2 —> t in probability . 

^ J H +1 

i= 1 

So we can hnd a further subsequence such that this convergence occurs almost surely. Calling 
this subsequence still (ti*,), the upper bound we get is 

t liminf u;(5 nfc , M t ) . 

k 

Because f" is continuous, this is zero almost surely. We conclude that P(A t ) = 1. □ 


17 Local time 


For a simple random walk S n , we can record the number of times that S n hits a particular 
integer x until time N: 

N 

L X = Yl 1 (Sn=x} • 

n= 1 

For Brownian motion, the situation is more complicated. Take, for instance, x — 0. Then 
in any interval [0, T\, B t will hit zero infinitely often (actually uncountable many times) and 
any sum as above will be infinite. So it makes more sense to try to hnd the amount of time 
B t spends at zero. For this purpose, we could consider f Q l{^=o} df. Again, this will be 
zero, since it is just the Lebesgue measure of the zero set. However, we can consider 

/it(A) := f d t for A C M Borel . 

Jo 

Then /i T is called the occupation measure until time T. One way to measure the time at x 
is to look at the density of the occupation measure at x. 


Definition 17.1. The local time of ( B t ) until time T at x G M is defined as 


L 2 X = lim — 
40 2e 


'-{B t e{x-e,i r+e)} 


dt = lim 
40 


— e, x + e) 
2e 


We will prove that the limit above exists in probability. Furthermore, using Ito’s formula 
we can hnd an integral representation, called Tanaka’s formula, for it. 


17.1 Tanaka’s formula 

The idea we will pursue is to apply Ito’s formula to \B t \. Of course, the function x i-4 |rr| is 
not twice continuously differentiable. But in the sense of distributional derivatives, we have 

= sign (re) and -^|x| = 2h 0 . 
ax ax 2 
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Therefore we might get 


or in integral form, 


d|-Bj| = sign (B t ) d B t + S 0 (B t ) d t , 


\B t \ = / T sign {B t ) d B t + f 5 0 (B t ) d t 
Jo Jo 

rT 

T 


sign (B t ) d B t + Lq , 


so that 


Li = \Bt\ 


sign (B t ) d B t . 


Lecture 36 


Theorem 17.2 (Tanaka’s formula). For all T > 0, 


L o = l ™7rFT(-e,e) 

Z6 


exists in probability. Furthermore, 


L 1 , = \B t \ - 


sign(B t ) dB t almost surely 


Proof. We cannot apply Ito to the absolute value function but we can after smoothing. For 
our particular smoothed version, let’s take / any smooth function with compact support in 
[—2, 2], with 0 < / < 1 and with f f — 1. Then define the mollified absolute value as 


fe(x) = e J \x - y\f(y/e) dy . 

This is a convolution with a smooth function, so it is smooth. Applying Ito’s formula, 

UBt) - f,(B „) = j\s.)'(B t ) d B, + i [(f.)"(B t ) it ■ 

To compute the derivatives, do a change of variable u = x — y to rewrite 


(37) 


fe(x) = 6 \u\f(e (x-u))du. 


So 


tK ^ -lr f I i/( e (x + h ~u))-f(e \x-u)) 
f e {x) = e lim j \u\ ---d u . 


h- 5>0 


By the mean value theorem, the quotient inside equals 

^/(e'^-w)) =e“ 1 / , (e _1 (c-M)) 
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for some c between x and x + h. Since the derivative of / also has compact support, 
we can use dominated convergence for 


r»oo pO 

f' t (x) = e~ 2 I \u\f\e{x—u)) du — e~ 2 I uf'(e~ l {x—u)) du—e~ 2 / uf(e~ 1 (x—u)) du . 

J JO J —oo 

These integrals can be done by parts: 


and 


so 


/ uf'ie 1 (a: — u)) du = e / /(e L (x — u)) du 

'o Jo 


r»0 pO 

uf\e~ l {x — u)) du — e / /(e -1 (x — u)) du , 


fe( x )= e 1 J sign(u)f(e \x~u)) du , 
which by a change of variables is 

fe( x ) = j sign (a: - ey)f(y ) dy . 

For the second derivative, again we pull the derivative inside (38) for 

fe(x) = e~ 2 [ sign(u)/'(e _1 (a; - «)) du . 


This is 


—2 


r»oo /*0 


/ (e (x — w)) dw — / f (e (x — w)) dw 


Lao 


and we can evaluate using a change of variable for 

/"(*) = 2e- 1 f(e~ 1 x) . 

Place these derivatives back into (37) for 


fe(B T ) - / e (S 0 ) = 


sign(S t - ey)f(y ) dy 


d5i + e / /(e ^j) df . 

Jo 


We will let e 4- 0. First for all x, 


|/ e (x) - |x|| = e 


-l 


(|x-y| - |x|)/(e y) dy 


(38) 


(39) 


< e / Ik - i/I - |i||/(e y) dy 


f2e 


-1 


= e ^ / ||x - y| - |x|| /(e y) dy 

J- 2e 

< 2 e . 
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In other words, f e (x) —* |x| uniformly. Therefore f ( (B T ) —> \B T \ and f e (B 0 ) —>• 0 almost 
surely. For the first term on the right of (39), 


f' e (x) = I sign (a: - ey)f(y) d y -» sign (a:) if x =/=■ 0 
and it is bounded by 1. Therefore for each t > 0, 

^(fe(Bt) — sign(Fh)) 2 —>• 0 

by the bounded convergence theorem. And again by the bounded convergence theorem and 
isometry, 


E 


f T f e {B t ) d B t - [ T sign(B t ) dB t ] 
Lao Jo 


r-T 


E (f'(B t ) - sign (B t )) 2 dt^O. 


This means J Q T f^(B t ) d B t —>• sign(B t ) d B t in L 2 and therefore in probability. 


Coming back to (39), we have shown that 

lime -1 / /(e -1 Fh) dt = \Bt\ — / sign(S() d B t in probability . 

To Jo Jo 


(40) 


Now we want to choose / to be close to (1/2)1(_ 11 ). Given <5 > 0 pick / to be smooth such 
that / has support in [—2, 2], / > (1/2)1(_ 11 ) and f f = 1 + S. Then //(1 + 5) satisfies the 
conditions of the above derivation and (40) holds for //(1 + <5). This means 


J o l(- e ,6)(^t) dt < e 


-l 


f{.e~ l B t )dt 


^(1 + h) 

We will finish up next time. 


I Bn 


sign (B t ) d B t 


in probability . 


□ 


Lecture 37 


We were almost done proving: 

Theorem 17.3 (Tanaka’s formula). For all T > 0, 

Ll = hm^ T (-e,e) 

e|0 Z6 

exists in probability. Furthermore, 


Lq = \B t \ — / sign(B t ) dB t almost surely . 

Jo 
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Proof. We have shown that for any 5 > 0, 


1 

2 e 


l ( _ e>e) (.B t ) dt < e / /(e 


^(1 + 5 ) 


|£ 7 


sign(-Bt) 


in probability , 


where / is a function that dominates |l(_ ej£ ). So 


lim P 

40 




l(-e,e)(-Bt) dt > (1 + §) 



sign (5*) d5 t 



0 . 


This is the upper bound (in probability) in Tanaka’s formula. For the lower bound, take / 
with support in [—2,2], 0 < / < (1/2)1(_ 11 ) and J f = 1 — 5 and repeat the above bound 
with > in place of <. □ 

Some remarks: 


• A similar argument gives existence of local time at other x-values: 


L T X = \B t ~x\ - \x 


sign (B a 


x ) d B s almost surely . 


We can easily get a different representation: 


2 L I = {Bt - x)+ - 


or 


\ L l = ( b t ~ x)- - x + + 1 

Proof. The sum of the two right sides is 


L{b 3 >£} dB s 


{b s <x} d B s 


I B r - x\ - b| 


sign (B s - x) d B s , 


which is Lf by Tanaka. On the other hand, the difference is 


(B t - x) + - (B t - x)_ - + x + - / 1 d B s , 

Jo 


which is 


B T — x + x — B T = 0 

This means they are both equal to (1/2)1%. 


□ 
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• For each x, the function T > L x has a continuous version which is non-decreasing and 
is constant on each component of the complement of the set {t : B t — x}. 


Proof. Continuity follows from the integral representation. Non-decreasing is a home¬ 
work problem. 

For the final statement, let r < s be rationals and use the last representation for 


L r x = 2 


( B s 


x) 


( B r 


X) 


\-{B u >x} 


On the event that the Brownian motion stays to the right of x for the time interval 

r, s], 


(D.s ~ x) + = B s - x, (B r - x) + = B r - s and f d B u = B r - B s , 


so L s x = L r x on this event. 

Now if Iff ^ L* 2 for two times t\ < t 2 , both in the same component of the complement 
of [t. : B t — x} (note this is a closed set, so its complement is a union of open intervals) 
then by continuity of local time, we can find two rationals r < s in this same component 
such that L r x ^ L s x . Without loss in generality, B t stays to the right of x on this interval 
and as we have seen above, this has probability zero. □ 


17.2 Distribution of local time 

We will now analyze the formula Lf = \B T \ — J Q T sign(5 s ) d5 s to find the distribution of 
local time. 

Proposition 17.4. The process X t = f* sign(B s ) dB s is a Broumian motion. 

Proof. For this result we need a lemma that we will prove next week. 

Lemma 17.5 (Levy’s characterization of Brownian motion). Let (X t ) be a martingale with 
continuous paths and X 0 = 0 such that Xf — t is a martingale. Then (X t ) is a Brownian 
motion. 

Our Xt is a continuous martingale, so we verify the second condition. For 0 < s < t, 
E[X t 2 - X 2 S | X s ] = E[(W - X s ) 2 | X s ] + 2E[X s (X t - X s ) \ X s ] . 


The second term is 

2A" s E[X t — X s | iF s ] — 0 , 
since (X t ) is a martingale. The first term is 


E 


rt \ 2 

sign (B u ) d B u ) | J 7 , 
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and can be evaluated by approximating with simple processes. To this end, for each n, let 
P n be a partition of [s,t\: 

p n = {s = 4 n) < • • • < 4? = 
and define the simple process S^ by 


s (n) = sign (B (n) )l r (n) («), 

' * ^fc —1 'k — l ,L k -I 


fc=i 


Now 


S'” 1 dfl, = ^SH 


fc=l 


where y k = sign(F> ( n ) ){B ( n ) — B,( n) ). As we have seen many times, for j < k, 


E [yjyk | -7^] = IE y k E[y k | | 7 S 


= 0 , 


so 



k n k n 


k =1 


k =1 




S . 


For notational convenience, set A — f sign (B u ) d B u and A n = f l dB u , so that A n —> A 
in L 2 . Therefore by Jensen and Cauchy-Schwarz, 

E \E[A 2 n | F a \ - E[A 2 \X S }\< E|A 2 - A 2 | < ||A n - A|| 2 ||A n + A\\ 2 ->■ 0 . 

The left side is E |E[A 2 | J 7 .,] — (t — s )|, so E[A 2 ] J 7 ,] = t — s almost surely. Returning to the 
beginning, 

E[X 2 - A 2 | J 7 ] = t - s , 
or 

E[( V 2 - t) - (X 2 - s) | F,} = 0 . 

□ 


The above proof can be used to show more: if (X t ) is in Xi? then the process 

(jf A s dR s ^ - ^ A 2 ds 

is a martingale. In particular, by Levy’s theorem, if ( X t ) is ±l-valued and progressively 
measurable, then f* X s d B s is a Brownian motion. 

From this proposition we can give a different characterization of local time. 



Theorem 17.6 (Levy’s identity for local time). Let M t = max 0 < s < t B s . Then the pairs of 
processes 

(\B t \,L\) and (M t — B t , M t ) 

have the same distribution. 

Before we prove this theorem let us think about what it says about the structure of local 
time. 


• First, for each fixed t, L f 0 has the same distribution as M t . Therefore for each a > 0, 

P(Lq > a) = 2P(B t > a) . 

In particular, for each t, > 0, L f 0 has zero probability to be 0. That is, in every nonzero 
interval [0,£], Brownian motion accumulates non-trivial local time. 

• The entire process Lg has the same distribution as the process M t . The maximum 
process M t is clearly continuous, non-decreasing and only increases when Brownian 
motion achieves a new maximum (think about the structure of the set of times on 
which B t achieves a new max). We can imagine drawing M t as a function of time 
pretty easily, so this gives us a way to visualize the process Lq. 

• The process M t increases when M t — B t comes to 0. Since this pair has the same 
distribution as (|Lh|,Lg), this means that Lg increases when \B t \ comes to 0. 

• Last, \B t \ has the same distribution as M t — B t . The hrst process is sometimes called 
reflected Brownian motion. 


Lecture 38 


The hrst goal today is to prove: 

Theorem 17.7 (Levy’s identity for local time). Let M t = maxo< s < i B s . Then the pairs of 
processes 

(\B t \,Ll) and (M t — B t , M t ) 

have the same distribution. 

Proof. The previous proposition, along with Tanaka’s formula, gives Lf + W t = \B t \, where 
W t is a Brownian motion: 

W t = f sign (B s ) d B s . 

Jo 

Dehne the Brownian motion Y t = —Wt and its maximum process N t = maxo< s < t Y t . We 
claim that 

N t = Lg for all t > 0 . 

To show this, we prove both inequalities. First, for all s, 

Y s = —W s — L S q— \B s \ < Lg 
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so N t = rnax 0 < s <( Y s < max 0 < s < 4 Lg = Lg (since Lg is nondecreasing). For the other inequal¬ 
ity, Lq < N t , consider two cases. If B t = 0 then 


N t >Y t = Ll- \B t \ = Lg . 

Otherwise, t is in some component of the complement of {s : B s = 0} and Lg is constant on 
this interval. Therefore setting to to be the left endpoint of this interval, B to = 0 and so 

L‘ 0 = = Y ta < N,„ < Nt . 


This establishes the claim. 

Since N t = Lg for all t > 0 and Y t — Lg — \B t \, we must have 

I BA = Li — Y = Nt- Y . 


So 

(| B t \,L° t ) = (N t -Y t ,N t ) . 

The last process has the same distribution as (M t — B t , M t ). 


□ 


18 Levy’s characterization of Brownian motion 

To prove the last result we used: 

Theorem 18.1 (Levy’s characterization of Brownian motion). Let (X t ) be a martingale with 
continuous paths and X 0 = 0 such that X f 2 — t is a martingale. Then (X t ) is a Brownian 
motion. 


Proof. The proof is taken from Varadhan’s stochastic processes book and will be in two 
steps. The bulk of the proof is to show that for each A G M, 


Y 


ty (A) := exp 



(41) 


is a martingale. Let us assume this for the moment and show that it suffices to prove the 
theorem. 

Step 1. If (43) holds, then let 0 < s < t. We obtain 


E [exp (X(X t - X s )) | X s ] = e- xx ‘e ^E 


exp ( AX, 


\ 2 j. \ 2 

\V At \ V AS 

= e^ XXs e~ e XXs ~~ 


= exp 


A 2 {t — s ) 
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If 0 < t 0 < ■ ■ ■ < tk, we want to use the above property to show that (Y\,... ,Y k ) : = 
(X tl — X to ,..., X tk — X tk l ) is Gaussian with independent entries of variance ti — U-i. To 
do this, let’s use the Cramer-Wold device. Letting (Gi,... , G*,) be a Gaussian vector with 
independent entries and variances t \ — /o,...,./*• — tk- 1 , we must show that for each vector 
of numbers (Ai,..., A/ c ), the variables 


AiW + • • • + A kYk and A 1 G 1 + • • • + A kGk 


have the same distribution. The variable on the right is Gaussian with mean zero and 
variance Y^!l=i — U-i), so its characteristic function is 


exp 


i 2 EL,A.(i. 



(42) 


To show that the left variable has this characteristic function, we find its moment generating 
function first. 

By applying the Tower property k times, along with the previous calculation (conditioning 
on ,..., T t g successively), for f el, 


]ggt(AiYi-t-hAfcYfc) 


E 


gtAfc(At fc Xt k _ 1 ) _ _ _ gfAi(At 1 Atg) 


k 

n ex p 

i= 1 



U- 1 ) 



This is the moment generating function of AiGi + • • • + A kGk, and we can take its derivatives 
at t — 0 to hnd that all moments agree as well. Last, we can plug these moments into the 
power series expansion for the characteristic function (since they do not grow too quickly) 
to hnd that Ai Yj + • • • + A kYk also has characteristic function (42). 

Next time we will prove (43). 

□ 


Lecture 39 


We continue with the proof of: 

Theorem 18.2 (Levy’s characterization of Brownian motion). Let (Ab) be a martingale with 
continuous paths and X 0 = 0 such that Xf — t is a martingale. Then ( X t ) is a Brownian 
motion. 

Proof. We now prove that for each A G 1, 

Y, = Y W - exp Lx, - (43) 

is a martingale. 
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The proof is actually like the proof of a central limit theorem. In other words, we will 
write X t as a sum of many small increments to prove that it is Gaussian distributed. So our 
first goal is to show 

/ X 2 t\ 

E exp ( XX t -— j = 1 for A G M, t > 0 . (44) 

In fact, this will actually suffice for the proof. The reason is that the martingale equality 
we want to show for 0 < s < t is 


E 


exp ^AX t 



exp 





or 


E 


exp ( \(X t - X s ) 




1 almost surely . 


The process (X s+t —X s ) t >o is also a continuous martingale starting from 0 such that (A s+t — 
X s ) 2 — t is a martingale. Therefore it satisfies the assumptions of this theorem. Yon can 
check that the proof of (44) below also works for this process when we replace E[-] with 
E[- | J 7 ,]. (We will remark this later again when you can check easily.) 


Step 2. (Upper bound) To this end, we define a sequence of stopping times for each e > 0: 


T~o,e = 0 and r k+1)t = min jt, r k)t + e, inf{.s : s > r fc)£ , \X S - X Tke \ > e}| . 

We will use these times to estimate X t , so we want them to be no bigger than t; this is the 
reason for the first term. We also want many of them; that is, we want them to be not very 
far apart. This is the reason for the second term. And the third term is there to make sure 
that the increments of X are not large. 

Note that each r k ^ e is a stopping time and T k ^ e = t for all large k. Therefore we can write 

OO OO 

Xt. = 'y ^ (Ar fc+ 1 e — X Tke ) and t = ^ ] (7fc+l,e — T k,e) ■ 

k =0 k =0 

To analyze the k -th increment, set z = X Tk+le — X Tke and r = r k+ i >e — r k , e . Then, setting 
J- k = X Tk e , 

E[z | T k ] = E[A Tfc+lje | T k \ - X Tk € = 0 

and 

E[^ 2 I Xk] = E« +i>e | Tk] - 2A r , E[A Tfe+l!E - \ T k \ - X^ 

= E l X r k+1 , e ~ T k+ i,e ! X k ] + E[r fc+lie | T k ] - X 2 k e 
= X r Ke - T k,e + Ebfc+i, e | T k \ - X 2 k e 
E[Tfc-(-i )e T k t | Tf c] 

= E[t I Tk] ■ 
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This gives 


E [z 2 — t | Tk] = 0 . 


Therefore, using \z\, r < e, if h G [0,1], 


E exp I Az - I — + 5 ) r I | T k 


is bounded by 


E 1 + (xz — ^ t\ + - fxz + f— + x\ t\ + C'a(|^|’' + t 3 ) | Fh 


This is evaluated as 


1 + E —hr Xz s\ t + — ^ r 2 + ^ A (l^| 3 + r? ) I ^~ k ’ 


which is bounded by 


1 + E — St + |A|e (— + h'j r + — (— + 5^) r + C\(ez 2 + e 2 r) \ Tk 


< 1 + E[(—h + C' x e)r | T k ] 


for some other constant C x . If 6 = C' x e, we obtain 


E exp lAz— I — + hJr]|J-fc <1 almost surely . 


We will continue next time. 


Lecture 40 


Proof. We finished last time by showing 


E exp ^Az — + SJ tJ | Tk <1 almost surely . 

For this same choice of h, we can successively condition on T n , T n ~\,... to get 


E exp A^(X rfc+M -X Tk e 


+ ^ j ^(r fc+ 1 >£ - T k , e ) ) < 1 • 


By Fatou, 


E exp I XX t — I — + h ) f ) < 1 . 
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Taking e J, 0, also 5 j. 0, so 


E exp 



< 1 . 


In the derivation above, we can replace E[-] with E[- | Xf (and consider the process 
X t+S — X s ), as described in last lecture. By then repeating exactly the same argument, we 
obtain 


E 


exp ( X(X t - X s ) 




< 1 . 


This statement has two consequences: exp y\X t - j-j i s integrable, and it is a supermartin¬ 

gale. 


Step 3. (Lower bound) For the other inequality, essentially the same calculation as above 
shows 


E 


exp 


\ 2 

Xz - [ -— S 


Xi. 


>l + E[(5-C'e)T\X k \ , 


and so by successive conditioning, 


Eexp A J2( X r k+ i,e ~ X nJ ~ ( -y - J2( Tk +i,e ~ Tk ^ - 1 


k =1 


A 2 


k= 1 


To take the limit in n, we will need to use dominated convergence. For this, we need a 
lemma. 


Lemma 18.3. Let (Z t ) be a nonnegative supermartingale with continuous paths. Then for 
each a > 0, 

( \ EZ 0 

P ( max Z t > a I < - . 

\o<s<t ) a 

Proof. Just as in the martingale inequality, we first use a discrete version. Suppose that 
Z\ , Z 2 ,... is a nonnegative supermartingale and define the stopping time 

r = mirijn > 1 : Z n > a} . 

Then by the optional stopping theorem, 

EZi > E > EZ T l{ r < n j > aP(r < n) . 

But {r < n} = {maxKj< n Zj > a}, so 

„ \ EZ 1 

\l<j<n J a 

Now apply this result to the supermartingale Z 0 , Z t2 -n , Z 2 t 2 ~ n ,... ,Z t to obtain 

P max Zj+ 2 —n > a 

\0<j<2 n J 

By continuity, as n oo, the probability on the left converges to P(ma x 0 < s < t Z t > a), 
completing the proof. □ 


A ^ EZp 
/ _ a 


104 



Apply the lemma to our supermartingale for 


P ( max exp (XX s -— ^ < - . 

\o <s<t \ 2 ) J a 

This is true for all A, so we can use it to get a tail estimate for the maximum of X s . For 
A > 0, 


P 


( max X s > a 

\0<s<t 


< P max exp 

\0<s<t 



< exp 



> exp 




Choose A = a/t for the bound 


P 


max X s > a 

\0<s<t 


< exp 



Therefore for A > 0, if we set M t = max 0 < s <t A s , 


E max e XXa = Ee XMt < ^e An P (M t > n) < ^e An e“^ < oo . 


This means that 


max exp (AAA + St) 

0 <s<t 


is integrable, and since it is an upper bound for 


exp exp A '^{X rk+i f - X Tk e ) - ( — - 5 ^(r fc+ i )£ - 


fc=i 


A 2 


Tb, 


< e T "+ 1 .e J 


k =1 


we can apply dominated convergence for 


E exp ( XX t - ( y - S ) t ) > 1 . 


Again we take S —> 0 with e to obtain 


A 2 t 


E exp ( XX t -— ) > 1 . 


Because we can replace X t with X t — X s and E[-] with E[- | J 7 ,], we have shown the other 
half of the martingale condition: 


E 


exp ^XX t 



> 1 


and we are done. 


□ 
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19 Stationary processes 

In this final part of the course, we will describe stationary sequences of random variables. 
We introduced martingales as a generalization of i.i.d. sequences. Here we will generalize 
i.i.d. sequences in a different way. 

Definition 19.1. A sequence (. X n ) is stationary if for each k and choices 1 < i\ < ■ ■ ■ < ik, 
the vectors (Xj n ..., X ik ) and (Xj 1+ i,... ,X ik+ 1 ) have the same distribution. 

Here are some remarks about the definition. 

• Of course [X tl ,..., X lk ) and (X il+m ,..., X ik+m ) have the same distribution for m > 1 
if the sequence is stationary. 

• Stationarity implies that the X n ’s are identically distributed (take k = 1). 

Lecture 41 

More remarks about stationary sequences. 

• A simple example comes from measure preserving transformations. Let (fl, E,P) be a 
probability space and T : H —> 0 measurable satisfying PoT -1 = P. Recall this means 

P(A) = P(T" 1 A) for all AeE. 

Such a T we call measure preserving. Let X : —> M be a random variable and define 

a sequence X 1 ,X 2 ,... by 

X^u) = X(u) and X k+1 (u) = X k (T(u)) for k > 1 . 

We claim that (X n ) is stationary. Indeed, if k > 1 and 1 < i\ < ■ ■ ■ < ik then for any 
Borel A C M fc , 

T-^co : (X h (cj),.. .,X ik (u)) 6 i} = (w : (X h+1 (u),.. .,X ik+1 (u)) G A} . 

Since T is measure preserving, 

P((4,...,4)ed) = P((4 +1,''', Xi k +1 )eA) , 
so these vectors have the same distribution. 

• Conversely, if (X n ) is stationary on some probability space (fl, E,P), then we can 
exhibit the sequence as the last example. In other words, we can find a space 9, a 
probability measure P, a P-preserving measurable map T : Cl Cl and a variable 
X : H —>■ M such that (X, X(T(u)), X(T 2 (uj)), ...) has the same distribution as (X n ). 

Let Cl be the space M N with the product sigma-algebra. Then define <f> : Cl —> H by 

$M = (AAM,X^),...) 
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and let P be the push forward P o <f> 1 . Last let T : Cl —» Cl be the shift map 

T{u\,U>2, ■ • •) = (^ 2 ) • • •) 

and define the random variable X : T2 — y M by 

X(uj 1 ,u>2, . . .) = Ui . 

Because <f> is measurable (you showed this on homework), P is T-invariant and the 
sequence 

(A", X oT,X o T 2 ,...) — (u\,U 2 , ■ ■ •) 
has the same distribution as (Xi , A 2 ,...). 

So we may view our stationary sequence as an element of the sequence space M N along 
with the measure preserving shift map T. So we will from now adopt this point of view, 
common in dynamical systems, and consider measure preserving systems. 

Given (f2, E,P) along with a measure-preserving (measurable) map T : — y we may 
begin by asking if we can decompose our system into smaller parts. One example comes 
from invariant events. Suppose AeS satisfies T~ l A = A. Then we can restrict our system 
to A. 

Proposition 19.2. LetX be the collection of all T-invariant events: 


I = {AeS: T~ 1 A = A} . 


Then 1 is a sigma-algebra, the invariant sigma-algebra. If A e X and P(A) > 0 then T is 
invariant for the conditioned measure P(- | A). 

Proof. The proof is pretty easy. The events 0 is in X and if A el then 

T~ X A C = (! T~ X A) C = A c , 


so A c E X. Last if A\, Ai,... E X then 

X" 1 (U n A n ) = U n T~ 1 A n = U n A n 


and this shows X is a sigma-algebra. 

If A E X has P(A) > 0 then for B E £, 


P^” 1 ^ | A) 


P((T"‘B)nA) 

P(A) 


P((X" 1 5) n (T-M)) 

P(A) 

P(r _1 (i? n A)) _ P(BnA) 
P(A) ““ P(A) 


P (B I A) . 


□ 
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In view of this proposition, the simplest systems will have X trivial. In a sense they are 
irreducible. 


Definition 19.3. A measurable T : 12 —>• II is called ergodic for (12, £,P) if 

A G X =>■ P(A) = 0 or 1 . 


The notation is a bit unclear in the literature. Sometimes the system (12, £, P, T) is called 
ergodic. Sometimes T is ergodic for P. Sometimes P is ergodic for T. We will use these 
interchangeably. 

There are various alternative characterization of ergodicity. Here is one: 


Proposition 19.4. T is ergodic for P if and only if every T-invariant measurable function 
f : 12 —>• M is constant almost surely. 

Proof. If every T-invariant function is constant, take Ael and consider f — 1^. This is 
T-invariant: 


f(T{u)) = U{T{u)) 


1 if T(u) G A 
0 if T(u) i A 


1 if u G A 

0 if u) ^ A 


f(u) ■ 


So I 4 is constant almost surely and must then be 0 or 1. In the first case P(A) = E/ = 0 
and in the second it is one. 

Conversely, suppose that T is ergodic and let / be a T-invariant function. Setting F(x) = 
P(/ < x ) to be the distribution function of /, we must have F(x) G {0,1} for all x, since 
{/ X is T-invariant. However lim a ,_>._ 0O F(x) = 0 and lirn^oo F(x) = 1, implying that 
F(x) = l[ c ,oo) f° r some cGl. It follows that f = c with probability one. □ 


Examples. 

1. Let 12 = {z G C : \z\ = 1} and for 6 G M, T(z) = e ld z. Then T preserves Lebesgue 
measure on 12 (with the Borel sigma-algebra). Actually if 6 — 27ra then T is ergodic if 
and only if a is irrational. See Billingsley, p. 316. 

Lecture 42 

2. Let P be an i.i.d. product measure on M N . Then P is ergodic for the shift T(xi, X 2 , ■ ■ •) = 
(x 2 ,x 3 ,...). 

Proof. The proof is similar to that of the Hewitt-Savage zero-one law. Given A, a 
shift-invariant event, we can find (by the n-X theorem - you proved this in homework) 
a sequence of cylinder events A n depending on the first n coordinates such that 

P(AAA n ) —>■ 0 . (45) 
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Approximating by the A n ’ s helps because shift-invariance of A implies approximate 
shift-invariance of A n , and a cylinder event can only be shift-invariant if it is trivial, 
giving that A is trivial. 

For the proof, if we write T for the shift, then A n and T n A n are independent, so 

|P(A) 2 -P(A)| = |P(A)P(T n A) — P(A fl T n A)\ 

< \F(A)F(T n A)-F(A n )F(T n A n )\ 

+ \P(A n n T n A n ) - P (A n T n A) I 

By shift-invariance of P, we also have 

F(T n A n AT n A) ->• 0 . 

This and (45) implies that the two terms above converge to 0. That is P(A ) 2 = P(A) 
and so P(A) = 0 or 1. □ 

19.1 Ergodic theorem 

The definition of ergodic for sequences is a direct translation of the one above. 

Definition 19.5. A sequence (X n ) of random variables is ergodic if it is stationary and 
every shift-invariant A e a (X n : n > 1) has probability zero or one. 

In this definition, shift-invariant means the following. Any A e <x( X n : n > 1) can be 
written as 

A = {u:(X 1 (u),X 2 {u),...)eH} 

for some Borel H C M N . Then A is shift-invariant if H is: if T : M N —» is given by 

T(x 1 ,x 2 , ■■■) = (x 2 ,x 3 ,...) 


then H = T~\H). 

The ergodic theorem is a law of large numbers in this more general setting. The proof 
comes directly from a lecture of Y. Peres on a simple proof of the ergodic theorem. It is 
called “Intuitive proofs of the ergodic theorem” and can be found on the microsoft website. 

Theorem 19.6 (Birkhoff’s ergodic theorem). Define Si(k ) = and Ai(k ) = 

jSi(k). If E|Xl| < oo and (X n ) is stationary then 

A n ( 1 ) —> E[Xl j X] almost surely . 

There are really two parts to the statement. The first is that the averages converge 
and the second is that the limit is E[Ab | I\. Here X is the invariant sigma-algebra. In 
the sequence setting, this is the set of events that are invariant under shift. That is, if 
$ : fl —> M n is the map 

4>M = (X 1 M,X 2 (a;),...) 
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then if we define T : M N —» M N as the left-shift and X' the T-invariant sigma-algebra of M N , 
then X is {c&'M : A e X'}. 

In the ergodic case. X is trivial and so 

A n (l ) —> EX| almost surely . 

Proof. This proof is based on Kamae, Katznelson-Weiss and Keane and we will show the 
ergodic case. It is enough to consider Xj > 0 for all j because in general we can separate 
into positive and negative parts: 

^ / n— 1 n— 1 

Xj = (Xj) + - (Xj). and -4„(1) = - E( A ‘+;>+ - E (A '‘+i)- 

\i=0 

So if we prove the result for nonnegative random variables, we can apply it to ( Xj) + and 
( Xj )_ and retrieve the result for Xj. 

Let 

A = limsupA n (l) e [0, oo] . 

n 

Note that A is a shift-invariant random variable: S'n(l) = *S'n-i(2) + X\ and so 

1 1 

limsupa4 n (l) = limsup —S n ( 1) = lirnsup — [S' n _i(2) + Ad] = limsup A n (2) , 

n n Tl n Tl n 

By ergodicity, then, A is constant almost surely. We will later prove that A < oo, but for 
now we must accept the possibility that A = oo. Fix any 

a < A 



and define 

l(k) = min{/ : Afk) > a} . 

(This is the first time that the averages exceed a.) 

We first explore a very special case. The general case will be an extension of the following 
argument. 

Case 1. Suppose that l(k) < L for all k , where X is a constant. We will just take the partial 
sum up to index n and cover the interval [ 1 , n] by consecutive subintervals on which the 
averages exceed a. We will begin covering starting at index 1 and then stop the first time 
we exceed index n. By assumption, all the subintervals will have length at most L. The 
endpoints of our subintervals will be ki and the lengths will be likf)-. 

k\ — \ and k l+ i = ki + l(ki) with m = rnaxji > 1 : ki < n} . 

Then by non negativity and definition of l(k), we obtain the “heart of the proof:” 

n m m 

E a '^E E l(ki)a > (n — L)a . 

j =1 2=1 i= 1 


110 



Here we have just summed the Xj s on the subintervals and on each one, the sum must 
exceed l(kj)a. We stop at the last one, l(k m ), and this last endpoint must come within 
distance L of n, by assumption. 

Now lim inf n ^ Y^j=i Xj > ot. This holds for all a < A, so lim inf n A n ( 1) > limsup n A n ( 1), 
proving existence of the limit. We will not finish this case, as it was more for motivation. 

Next time we will do the general case. □ 

Lecture 43 


Now we continue with the proof of the general case of the ergodic theorem. 


Proof. Case 2. In the general case, we want to almost bound l(k), so given e > 0 pick L 
such that 


P (l(k) > L) < e . 


To reduce back to the previous case, we will now modify the variables. We look at the 
sequence (W, X 2 ,...) and for each k, if l[k) < L (that is, starting from this variable, we do 
not need to wait too long for the average to exceed a), we leave X k as it is, and if l[k ) > L , 
we set it equal to a: 


X k if Z(Jfe) < L 
a if l{k ) > L 


We can write X k = X k + Z kl where 


Z k 


0 if l[k) < L 

a-X k if l{k) > L 


Notice here that Z k > 0. To see why, suppose that l[k ) > L. Then l[k) > 1 and so by 
definition, X k = Ai{k) < a, giving Z k = a — X k > 0. 

Writing A* t (k) = \ Xf +k and l*{k) = min{7 : A^(k) > a}, then 


r(k) 


l(k ) if l(k) < L 
1 if l{k) > L 


(46) 


Indeed, if l[k ) > L then XI = a , and so l[k)* — 1 < L. Otherwise l[k) < L and so 
Ai(k){k) > a with Aj(k) < a for j < l{k). Now At k ^(k) > A^ k )(k) > a, giving l*(k) < l(k). 
On the other hand, if l*[k) < l(k ) then Ai*^{k) > a while Anj-yik) < a. This means 
that there is some j < l*{k) such that X k+J ^ X k+] and so l[k + j) > L. In particular, 
l(k + j) > l{k) — j and so 


Ai(k){k) — -(Sj(k) + Sy k )_j(k + j)) < -( Aj(k) + Ay k )_j(k + j)) < a , 


contradicting the definition of l{k). This shows l*[k) > l[k) and consequently (46). 
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Now X* satisfies the assumptions of the last case, so by exactly the same argument as 
before, we get the second main inequality 

n 

X* > (n — L)a for all n . (47) 

i =i 

To derive this inequality, we do not even need to know that the X*’s are ergodic or integrable 
(see the previous proof). We only need that they are nonnegative. Taking expectation and 
using stationarity, 

(n — L)a < vMXl = n(EAR + Zi) . 

Because Z\ < a and is only nonzero when 1(1) > L (and this event has probability at most 
e), we obtain 

(n — L)a < n(KXi + ae) , 
or KX\ > (1 — e)a. This is true for all a < A and e > 0, so 

EXi > A , 


proving that A < oo. 

Now we apply this result also to the sequence ( Z n ). It is integrable, since it takes values 
0 or a — Xk (but only when X^ < a) and it is still stationary. You must only verify that it 
is ergodic (this follows from a general fact that you can check - a stationary sequence which 
is a function of an ergodic sequence is still ergodic). So also 


ae 


> EZ l > lim sup — V" Z 

n n ^ • 


3=1 


Returning to (47), 


1 

n 


^TXj + ^TZj} > a(l — L/n) . 

d=l 3=1 


So 


This gives 


a 


^ n ^ n 

< lim inf — ^ Xj + lim sup — lim inf A n ( 1 ) + 

n Tl . n U n 

3=1 3=1 


ae . 


lim inf A n ( 1 ) > a(l — e) 

n 

and since e is arbitrary and a is any number < A, 


lim inf A n (l) > A, so lim inf A n (l) = limsupA n (l) 

n n ^ 


and the limit exists. 
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To prove that A = EAb, we have already shown the inequality >. For <, note that if the 
Xj’s were bounded, we could use dominated convergence for equality. In the general case, 
we apply the result we already have to min{Aj, M } for M > 0: 

— 1 n 

A > lim — min{AA, M} — E min{Ad, M } . 

n n z -—' 

j = 1 


Take M —> oo for A > EA^. □ 

19.2 Structure of ergodic measures 

Of the many characterizations of ergodic measures, one of the more useful ones exhibits them 
as extremal invariant measures. Define 

For a given (D, E) and T : 12 —y 12 measurable, we define 

Mt — {T-invariant probability measures on (12, E)} . 

Recall that a subset S of a vector space V over M is convex if Xv + (1 — A )w G S whenever 
v,w G S and A G (0,1). A point v G S is called an extreme point of S if it cannot be written 
as a convex combination of other elements of S'; that is, 

v = Xwi + (1 — A )w 2 for A G (0,1) and uq, w 2 G S W\ = w 2 ■ 

Proposition 19.7. The set A4 t is convex and its extreme points are the ergodic probability 
measures. Furthermore distinct ergodic measures are mutually singular. That is, if //, v are 
ergodic and not equal, there exists AgE such that p(A) = 1 = u(A c ). 

Proof. If Hi, /12 G M.t and A G [0,1], then for A G E, setting p = Xpi + (1 — A)/i 2 , 

p(T~ l A) = Xpi(T~ 1 A) + (1 - A )H2(T~ 1 A) = A pi(A) + (1 - A)/i 2 (A) = p(A) . 

Next assume that p is not ergodic. Then there exists A G X such that p(A) G (0,1). 
Then we can write 

M‘) = I A)p(A) + p(- | A c )p(A c ) . 

Both | A) and \ A c ) are T-invariant, and p is a non-trivial convex combination of 
them, so it is not extreme. 

Conversely suppose that p is ergodic. If we write p = A pi + (1 — A )/i 2 for A G (0,1) and 
pi , p 2 G A4t, then for any A G X, 

Xpi(A) + (1 — X)p 2 (A) = p(A) G {0,1} . 

Since A G (0,1), this implies that pi(A) = /^(A) for all A G X. To show they agree on E, 
let A G E and apply the ergodic theorem to p: for some set E G E with p(E) = 1, 

^ n— 1 

— 1 A(T k uj)) —> p(A ) for <jj G E . 

n 

k =0 
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It follows that also H\{E) = / 12 (E) = 1 and so this convergence occurs /q-almost surely and 
/^-almost surely. But then by the dominated convergence theorem, for i = 1,2, 

^ n —1 

Hi(A) = limE w - l A {T k u) = /.i(A) , 

n n 

k =0 


meaning fii = fi 2 - 

Last we have shown above that if two measures /i, v e Air agree on Z then they are 
equal. So if yU 7 ^ v we can find A el such that n(A) ^ v(A). If these measures are ergodic, 
then one of these probabilities must be 0 and one must be 1, giving mutual singularity. □ 
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